Sep 18 23:38:53 devstack cinder-volume[74974]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 18 23:38:53 devstack cinder-volume[74974]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 18 23:38:53 devstack cinder-volume[74974]: we strongly recommend against using it for new projects. Sep 18 23:38:53 devstack cinder-volume[74974]: If you are already using Eventlet, we recommend migrating to a different Sep 18 23:38:53 devstack cinder-volume[74974]: framework. For more detail see Sep 18 23:38:53 devstack cinder-volume[74974]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 18 23:38:53 devstack cinder-volume[74974]: import eventlet # noqa Sep 18 23:38:55 devstack cinder-volume[74974]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 23:38:55 devstack cinder-volume[74974]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 23:38:55 devstack cinder-volume[74974]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 23:38:56 devstack cinder-volume[74974]: INFO dbcounter [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Registered counter for database cinder Sep 18 23:38:56 devstack cinder-volume[74974]: DEBUG oslo_db.sqlalchemy.engines [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG dbcounter [-] [74974] Writer thread running {{(pid=74974) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 23:38:57 devstack cinder-volume[74974]: INFO cinder.rpc [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 18 23:38:57 devstack cinder-volume[74974]: INFO cinder.rpc [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_db.sqlalchemy.engines [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:38:57 devstack cinder-volume[74974]: INFO cinder.volume.manager [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Determined volume DB was empty at startup. Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG cinder.volume.manager [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74974) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 18 23:38:57 devstack cinder-volume[74974]: INFO cinder.volume.manager [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 18 23:38:57 devstack cinder-volume[74974]: WARNING stevedore.named [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 23:38:57 devstack cinder-volume[74974]: WARNING castellan.key_manager [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 23:38:57 devstack cinder-volume[74974]: WARNING cinder.keymgr.conf_key_mgr [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG cinder.volume.drivers.lvm [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74974) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_concurrency.processutils [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_concurrency.processutils [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] CMD "cinder-rtstool verify" returned: 0 in 0.425s {{(pid=74974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_db.sqlalchemy.engines [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:38:57 devstack cinder-volume[74974]: INFO cinder.rpc [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 18 23:38:57 devstack cinder-volume[74974]: INFO cinder.rpc [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 18 23:38:57 devstack cinder-volume[74974]: WARNING stevedore.named [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 23:38:57 devstack cinder-volume[74974]: WARNING castellan.key_manager [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 23:38:57 devstack cinder-volume[74974]: INFO cinder.volume.manager [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_db.sqlalchemy.engines [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:38:57 devstack cinder-volume[74974]: INFO oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Starting 1 workers Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Started child 75125 {{(pid=74974) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Full set of CONF: {{(pid=74974) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 18 23:38:57 devstack cinder-volume[75125]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] ******************************************************************************** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Configuration options gathered from: {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] ================================================================================ {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] allow_availability_zone_fallback = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] allow_compression_on_image_upload = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] allowed_direct_url_schemes = [] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] api_rate_limit = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] auth_strategy = keystone {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] az_cache_duration = 3600 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_availability_zone = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_host = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_name = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_stats_polling_interval = 60 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backup_api_class = cinder.backup.api.API {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backup_name_template = backup-%s {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:57 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backup_use_same_host = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backup_use_temp_snapshot = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] chap_password = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] chap_username = {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cinder_internal_tenant_project_id = 484f811eee33454296996ba127f9a10f {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cinder_internal_tenant_user_id = 9f09d24b8ec345718361b045d4c10b2c {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cloned_volume_same_az = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cluster = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] compression_format = gzip {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] compute_api_class = cinder.compute.nova.API {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] config_dir = [] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] config_source = [] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] control_exchange = openstack {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] debug = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] default_availability_zone = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] default_group_type = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] default_volume_type = lvmdriver-1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] disk_geometry = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] driver_client_cert = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] driver_client_cert_key = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] driver_data_namespace = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] driver_ssl_cert_path = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] driver_ssl_cert_verify = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] driver_use_ssl = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] enable_force_upload = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] enable_new_services = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] enable_unsupported_driver = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] enabled_backends = ['lvmdriver-1'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] enforce_multipath_for_image_xfer = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] filter_function = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance_api_insecure = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance_api_servers = ['http://192.168.122.119/image'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance_api_ssl_compression = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance_ca_certificates_file = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance_catalog_info = image:glance:publicURL {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance_certfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance_keyfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance_num_retries = 3 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance_request_timeout = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] goodness_function = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] graceful_shutdown_timeout = 5 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] group_api_class = cinder.group.api.API {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] host = devstack {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] image_compress_on_upload = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] image_conversion_address_space_limit = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] image_conversion_cpu_limit = 60 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[75125]: INFO cinder.volume.manager [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] image_conversion_disable = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] image_introspection_address_space_limit = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] image_introspection_cpu_limit = 60 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] image_upload_use_cinder_backend = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] image_upload_use_internal_tenant = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] image_volume_cache_enabled = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] image_volume_cache_max_count = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] image_volume_cache_max_size_gb = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] init_host_max_objects_retrieval = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] instance_format = [instance: %(uuid)s] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] iscsi_target_flags = {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] iscsi_write_cache = on {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] iser_helper = tgtadm {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] iser_ip_address = 192.168.122.119 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] iser_port = 3260 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] log_color = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] log_config_append = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] log_dir = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] log_file = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] log_options = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] log_rotate_interval = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] log_rotate_interval_type = days {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] log_rotation_type = none {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] max_age = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] max_logfile_count = 30 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] max_logfile_size_mb = 200 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] max_over_subscription_ratio = 20.0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] message_reap_interval = 86400 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] message_ttl = 2592000 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] migration_create_volume_timeout_secs = 300 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] monkey_patch = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] monkey_patch_modules = [] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] my_ip = 192.168.122.119 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] no_snapshot_gb_quota = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] num_iser_scan_tries = 3 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] num_shell_tries = 3 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] num_volume_device_scan_tries = 3 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] nvmeof_conn_info_version = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] nvmet_ns_id = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] nvmet_port_id = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] osapi_max_limit = 1000 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] osapi_volume_ext_list = [] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] osapi_volume_listen = 0.0.0.0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] osapi_volume_listen_port = 8776 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] osapi_volume_use_ssl = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] osapi_volume_workers = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] per_volume_size_limit = -1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] periodic_fuzzy_delay = 60 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] periodic_interval = 60 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] project_id_regex = [0-9a-f\-]+ {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] public_endpoint = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] publish_errors = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] quota_backup_gigabytes = 1000 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] quota_backups = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] quota_gigabytes = 1000 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] quota_groups = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] quota_snapshots = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] quota_volumes = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] rate_limit_burst = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] rate_limit_except_level = CRITICAL {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] rate_limit_interval = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] reinit_driver_count = 3 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] replication_device = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] report_discard_supported = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] report_interval = 120 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] reservation_clean_interval = 86400 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] reservation_expire = 86400 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] reserved_image_namespaces = [] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] reserved_percentage = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] rpc_response_timeout = 120 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] run_external_periodic_tasks = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] scst_target_driver = iscsi {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] scst_target_iqn_name = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_down_time = 720 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] shell_completion = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] snapshot_name_template = snapshot-%s {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] snapshot_same_host = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] split_loggers = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] state_path = /opt/stack/data/cinder {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] storage_availability_zone = nova {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] storage_protocol = iSCSI {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] syslog_log_facility = LOG_USER {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] target_helper = lioadm {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] target_ip_address = 192.168.122.119 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] target_port = 3260 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] target_protocol = iscsi {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] target_secondary_ip_addresses = [] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] trace_flags = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] transfer_api_class = cinder.transfer.api.API {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] transport_url = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] until_refresh = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] use_chap_auth = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] use_default_quota_class = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] use_journal = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] use_json = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] use_multipath_for_image_xfer = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] use_stderr = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] use_syslog = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] verify_glance_signatures = enabled {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volume_api_class = cinder.volume.api.API {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volume_backend_name = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volume_clear = zero {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volume_clear_ionice = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volume_clear_size = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volume_copy_bps_limit = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volume_dd_blocksize = 1M {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volume_name_template = volume-%s {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volume_service_inithost_offload = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volume_usage_audit_period = month {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] zoning_mode = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_concurrency.disable_process_locking = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.auth_section = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.auth_type = password {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.auth_version = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.cache = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.certfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.delay_auth_decision = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.http_connect_timeout = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.include_service_catalog = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.insecure = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.interface = public {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.keyfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_password = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcache_username = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.region_name = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.service_token_roles_required = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.service_type = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.token_cache_time = 300 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.119/identity {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.backend = dogpile.cache.null {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.backend_argument = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.backend_expiration_time = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.config_prefix = cache.oslo {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.debug_cache_backend = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.enable_retry_client = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.enable_socket_keepalive = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.enabled = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.expiration_time = 600 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.hashclient_retry_attempts = 2 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.memcache_dead_retry = 300 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.memcache_pool_maxsize = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.memcache_sasl_enabled = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.password = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.proxies = [] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.redis_db = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.redis_sentinel_service_name = mymaster {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.redis_server = localhost:6379 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.retry_attempts = 2 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.retry_delay = 0.0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.socket_keepalive_count = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.socket_keepalive_idle = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.socket_keepalive_interval = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.socket_timeout = 1.0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.tls_allowed_ciphers = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.tls_cafile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.tls_certfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.tls_enabled = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.tls_keyfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cache.username = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] coordination.backend_url = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.asyncio_connection = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.asyncio_slave_connection = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.backend = sqlalchemy {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.connection = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.connection_debug = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.connection_parameters = {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.connection_recycle_time = 3600 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.connection_trace = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.db_inc_retry_interval = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.db_max_retries = 20 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.db_max_retry_interval = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.db_retry_interval = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.max_overflow = 50 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.max_pool_size = 5 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.max_retries = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.mysql_wsrep_sync_wait = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.pool_timeout = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.retry_interval = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.slave_connection = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.sqlite_synchronous = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.synchronous_reader = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] database.use_db_reconnect = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_tracing.insecure = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler.connection_string = messaging:// {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler.enabled = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler.es_doc_type = notification {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler.es_scroll_size = 10000 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler.es_scroll_time = 2m {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler.filter_error_trace = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler.hmac_keys = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler.sentinel_service_name = mymaster {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler.socket_timeout = 0.1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler.trace_requests = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler.trace_sqlalchemy = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler_jaeger.process_tags = {} {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler_jaeger.service_name_prefix = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] profiler_otlp.service_name_prefix = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_policy.enforce_new_defaults = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_policy.policy_default_rule = default {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_policy.policy_file = policy.yaml {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_policy.remote_timeout = 60.0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] privsep_osbrick.group = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] privsep_osbrick.helper_command = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] privsep_osbrick.user = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cinder_sys_admin.group = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cinder_sys_admin.helper_command = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] cinder_sys_admin.user = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_user.auth_section = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_user.auth_type = password {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_user.cafile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_user.certfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_user.collect_timing = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_user.insecure = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_user.keyfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_user.send_service_user_token = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_user.split_loggers = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_user.timeout = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_user.tls_ciphers = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] service_user.tls_min_version = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance.auth_section = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance.auth_type = password {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance.certfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance.collect_timing = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance.insecure = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance.keyfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance.region_name = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance.split_loggers = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance.timeout = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance.tls_ciphers = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] glance.tls_min_version = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.backend_availability_zone = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.chap_password = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.chap_username = {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.disk_geometry = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.driver_client_cert = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.driver_client_cert_key = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.driver_data_namespace = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.driver_use_ssl = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.enable_unsupported_driver = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.extra_capabilities = {} {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.filter_function = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.goodness_function = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.iscsi_target_flags = {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.iscsi_write_cache = on {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.iser_helper = tgtadm {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.iser_ip_address = 192.168.122.119 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.iser_port = 3260 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.lvm_mirrors = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.lvm_share_target = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.lvm_type = auto {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.num_shell_tries = 3 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.nvmet_port_id = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.replication_device = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.report_discard_supported = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.reserved_percentage = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.scst_target_driver = iscsi {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack sudo[75132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.scst_target_iqn_name = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.storage_protocol = iSCSI {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.target_helper = tgtadm {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.target_ip_address = 192.168.122.119 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.target_port = 3260 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.target_protocol = iscsi {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.trace_flags = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.unique_fqdn_network = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.use_chap_auth = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack sudo[75132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.volume_backend_name = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.volume_clear = zero {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.volume_clear_ionice = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.volume_clear_size = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.volume_group = cinder-volumes {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_reports.file_event_handler = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_reports.log_dir = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.backend_availability_zone = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.backend_host = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.chap_password = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.chap_username = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.chiscsi_conf = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.disk_geometry = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.driver_client_cert = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.driver_data_namespace = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.driver_use_ssl = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.extra_capabilities = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.filter_function = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.goodness_function = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.iser_helper = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.iser_ip_address = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.iser_port = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.iser_target_prefix = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.lvm_conf_file = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.lvm_mirrors = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.lvm_share_target = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.lvm_type = auto {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.num_shell_tries = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.nvmet_port_id = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.replication_device = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.report_discard_supported = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.reserved_percentage = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.scst_target_driver = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.storage_protocol = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.target_helper = lioadm {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.target_ip_address = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.target_port = 3260 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.target_protocol = iscsi {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.trace_flags = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.use_chap_auth = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.volume_clear = zero {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.volume_clear_size = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] lvmdriver-1.volumes_dir = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.ssl = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.ssl_version = {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_notifications.driver = [] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_notifications.retry = -1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] oslo_messaging_notifications.transport_url = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] key_manager.fixed_key = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.barbican_api_version = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.barbican_endpoint = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.barbican_endpoint_type = public {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.barbican_region_name = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.cafile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.certfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.collect_timing = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.insecure = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.keyfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.number_of_retries = 60 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.retry_delay = 1 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.send_service_user_token = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.split_loggers = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.timeout = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.tls_ciphers = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.tls_min_version = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.verify_ssl = True {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican.verify_ssl_path = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican_service_user.auth_section = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican_service_user.auth_type = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican_service_user.cafile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican_service_user.certfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican_service_user.collect_timing = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican_service_user.insecure = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican_service_user.keyfile = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican_service_user.split_loggers = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican_service_user.timeout = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican_service_user.tls_ciphers = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] barbican_service_user.tls_min_version = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.approle_role_id = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.approle_secret_id = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.auth_method = approle {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.auth_path = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.kv_mountpoint = secret {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.kv_path = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.kv_version = 2 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.namespace = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.root_token_id = **** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.ssl_ca_crt_file = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.timeout = 60.0 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.token_file = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.token_role = None {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.use_ssl = False {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:38:58 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] ******************************************************************************** {{(pid=74974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 18 23:38:58 devstack sudo[75132]: pam_unix(sudo:session): session closed for user root Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:58 devstack sudo[75138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:38:58 devstack sudo[75138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:38:58 devstack sudo[75138]: pam_unix(sudo:session): session closed for user root Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.252s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 23:38:58 devstack cinder-volume[75125]: INFO cinder.brick.local_dev.lvm [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:38:58 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:58 devstack sudo[75199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 23:38:58 devstack sudo[75199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:38:59 devstack sudo[75199]: pam_unix(sudo:session): session closed for user root Sep 18 23:38:59 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:38:59 devstack cinder-volume[75125]: DEBUG cinder.brick.local_dev.lvm [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75125) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 18 23:38:59 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:59 devstack sudo[75328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:38:59 devstack sudo[75328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:38:59 devstack sudo[75328]: pam_unix(sudo:session): session closed for user root Sep 18 23:38:59 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:38:59 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:59 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:38:59 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:59 devstack sudo[75508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:38:59 devstack sudo[75508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:38:59 devstack sudo[75508]: pam_unix(sudo:session): session closed for user root Sep 18 23:38:59 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:38:59 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:59 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:38:59 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:38:59 devstack sudo[75604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 18 23:38:59 devstack sudo[75604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:00 devstack sudo[75604]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:00 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.282s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:00 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:00 devstack sudo[75689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 23:39:00 devstack sudo[75689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:00 devstack sudo[75689]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:00 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:00 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:00 devstack sudo[75746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 23:39:00 devstack sudo[75746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:00 devstack sudo[75746]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:00 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:00 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:00 devstack sudo[75765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:39:00 devstack sudo[75765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:01 devstack sudo[75765]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:01 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:01 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:01 devstack sudo[75832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:39:01 devstack sudo[75832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:01 devstack sudo[75832]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:01 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:01 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:01 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:01 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:01 devstack sudo[75855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:39:01 devstack sudo[75855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:01 devstack sudo[75855]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:01 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.331s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:01 devstack cinder-volume[75125]: INFO cinder.volume.drivers.lvm [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 18 23:39:01 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:01 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:01 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:01 devstack sudo[75927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:39:01 devstack sudo[75927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:02 devstack sudo[75927]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:02 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:02 devstack cinder-volume[75125]: DEBUG cinder.volume.drivers.lvm [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Updating volume stats {{(pid=75125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 23:39:02 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:02 devstack sudo[75930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 23:39:02 devstack sudo[75930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:02 devstack sudo[75930]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:02 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:02 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:02 devstack sudo[75933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:39:02 devstack sudo[75933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:02 devstack sudo[75933]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:02 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:02 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:02 devstack sudo[75942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:39:02 devstack sudo[75942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:02 devstack sudo[75942]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:02 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:02 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:02 devstack sudo[75945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:39:02 devstack sudo[75945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:03 devstack sudo[75945]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:03 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:03 devstack cinder-volume[75125]: INFO cinder.volume.driver [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Driver hasn't implemented _init_vendor_properties() Sep 18 23:39:03 devstack cinder-volume[75125]: DEBUG cinder.volume.driver [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75125) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 18 23:39:03 devstack cinder-volume[75125]: DEBUG oslo_db.sqlalchemy.engines [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75125) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:39:03 devstack cinder-volume[75125]: DEBUG dbcounter [-] [75125] Writer thread running {{(pid=75125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 23:39:03 devstack cinder-volume[75125]: DEBUG cinder.db.api [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Building query based on filter {{(pid=75125) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 18 23:39:03 devstack cinder-volume[75125]: DEBUG cinder.image.image_utils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75125) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 18 23:39:03 devstack cinder-volume[75125]: INFO cinder.keymgr.migration [None req-5895a0d5-e1b3-4331-9d2f-7f9c7ce839f1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 18 23:39:03 devstack cinder-volume[75125]: DEBUG cinder.volume.drivers.lvm [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Updating volume stats {{(pid=75125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 23:39:03 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:03 devstack sudo[75949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 23:39:03 devstack sudo[75949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:03 devstack sudo[75949]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:03 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:03 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:03 devstack sudo[75953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:39:03 devstack sudo[75953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:03 devstack sudo[75953]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:03 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:03 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:03 devstack sudo[75958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:39:03 devstack sudo[75958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:04 devstack sudo[75958]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:04 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:04 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:04 devstack sudo[75961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:39:04 devstack sudo[75961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:04 devstack sudo[75961]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:04 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:04 devstack cinder-volume[75125]: DEBUG cinder.manager [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Notifying Schedulers of capabilities ... {{(pid=75125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:39:04 devstack cinder-volume[75125]: INFO cinder.volume.manager [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Driver initialization completed successfully. Sep 18 23:39:04 devstack cinder-volume[75125]: INFO cinder.manager [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Initiating service 2 cleanup Sep 18 23:39:04 devstack cinder-volume[75125]: INFO cinder.manager [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Service 2 cleanup completed. Sep 18 23:39:04 devstack cinder-volume[75125]: DEBUG cinder.service [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Creating RPC server for service cinder-volume {{(pid=75125) start /opt/stack/cinder/cinder/service.py:231}} Sep 18 23:39:04 devstack cinder-volume[75125]: DEBUG cinder.service [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75125) start /opt/stack/cinder/cinder/service.py:237}} Sep 18 23:39:04 devstack cinder-volume[75125]: INFO cinder.volume.manager [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 18 23:39:04 devstack cinder-volume[75125]: DEBUG cinder.volume.drivers.lvm [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Updating volume stats {{(pid=75125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 23:39:04 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:04 devstack sudo[75964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 23:39:04 devstack sudo[75964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:04 devstack sudo[75964]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:04 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:04 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:04 devstack sudo[75967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:39:04 devstack sudo[75967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:05 devstack sudo[75967]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:05 devstack sudo[75972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:39:05 devstack sudo[75972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:05 devstack sudo[75972]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:39:05 devstack sudo[75975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:39:05 devstack sudo[75975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:39:05 devstack sudo[75975]: pam_unix(sudo:session): session closed for user root Sep 18 23:39:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:39:05 devstack cinder-volume[75125]: INFO cinder.volume.manager [None req-f1ffa187-3e0a-43d5-b507-e7c6efde02d0 None None] Driver post RPC initialization completed successfully. Sep 18 23:39:07 devstack cinder-volume[74974]: DEBUG dbcounter [-] [74974] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74974) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:39:15 devstack cinder-volume[75125]: DEBUG dbcounter [-] [75125] Writing DB stats cinder:SELECT=2 {{(pid=75125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:39:15 devstack cinder-volume[75125]: DEBUG dbcounter [-] [75125] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:40:05 devstack cinder-volume[75125]: DEBUG oslo_service.periodic_task [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:40:05 devstack cinder-volume[75125]: DEBUG cinder.volume.drivers.lvm [None req-035e0834-514a-4137-a078-be471a61f692 None None] Updating volume stats {{(pid=75125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 23:40:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:40:05 devstack sudo[77986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 23:40:05 devstack sudo[77986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:40:05 devstack sudo[77986]: pam_unix(sudo:session): session closed for user root Sep 18 23:40:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:40:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:40:05 devstack sudo[77989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:40:05 devstack sudo[77989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:40:06 devstack sudo[77989]: pam_unix(sudo:session): session closed for user root Sep 18 23:40:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:40:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:40:06 devstack sudo[78010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:40:06 devstack sudo[78010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:40:06 devstack sudo[78010]: pam_unix(sudo:session): session closed for user root Sep 18 23:40:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:40:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:40:06 devstack sudo[78013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:40:06 devstack sudo[78013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:40:06 devstack sudo[78013]: pam_unix(sudo:session): session closed for user root Sep 18 23:40:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:40:06 devstack cinder-volume[75125]: DEBUG cinder.manager [None req-035e0834-514a-4137-a078-be471a61f692 None None] Notifying Schedulers of capabilities ... {{(pid=75125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:40:06 devstack cinder-volume[75125]: DEBUG oslo_service.periodic_task [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running periodic task VolumeManager._thread_info {{(pid=75125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:40:06 devstack cinder-volume[75125]: DEBUG cinder.volume.manager [None req-035e0834-514a-4137-a078-be471a61f692 None None] thread count: 6 {{(pid=75125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:40:06 devstack cinder-volume[75125]: DEBUG cinder.volume.manager [None req-035e0834-514a-4137-a078-be471a61f692 None None] thread info: [<_MainThread(MainThread, started 128937655582848)>, , , , , ] {{(pid=75125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:41:05 devstack cinder-volume[75125]: DEBUG oslo_service.periodic_task [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:41:05 devstack cinder-volume[75125]: DEBUG cinder.volume.drivers.lvm [None req-035e0834-514a-4137-a078-be471a61f692 None None] Updating volume stats {{(pid=75125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 23:41:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:41:05 devstack sudo[81338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 23:41:05 devstack sudo[81338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:41:05 devstack sudo[81338]: pam_unix(sudo:session): session closed for user root Sep 18 23:41:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:41:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:41:05 devstack sudo[81343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:41:05 devstack sudo[81343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:41:06 devstack sudo[81343]: pam_unix(sudo:session): session closed for user root Sep 18 23:41:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:41:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:41:06 devstack sudo[81350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:41:06 devstack sudo[81350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:41:06 devstack sudo[81350]: pam_unix(sudo:session): session closed for user root Sep 18 23:41:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:41:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:41:06 devstack sudo[81353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:41:06 devstack sudo[81353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:41:06 devstack sudo[81353]: pam_unix(sudo:session): session closed for user root Sep 18 23:41:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:41:06 devstack cinder-volume[75125]: DEBUG cinder.manager [None req-035e0834-514a-4137-a078-be471a61f692 None None] Notifying Schedulers of capabilities ... {{(pid=75125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:41:06 devstack cinder-volume[75125]: DEBUG oslo_service.periodic_task [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running periodic task VolumeManager._thread_info {{(pid=75125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:41:06 devstack cinder-volume[75125]: DEBUG cinder.volume.manager [None req-035e0834-514a-4137-a078-be471a61f692 None None] thread count: 6 {{(pid=75125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:41:06 devstack cinder-volume[75125]: DEBUG cinder.volume.manager [None req-035e0834-514a-4137-a078-be471a61f692 None None] thread info: [<_MainThread(MainThread, started 128937655582848)>, , , , , ] {{(pid=75125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:41:15 devstack cinder-volume[75125]: DEBUG dbcounter [-] [75125] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:42:05 devstack cinder-volume[75125]: DEBUG oslo_service.periodic_task [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:42:05 devstack cinder-volume[75125]: DEBUG cinder.volume.drivers.lvm [None req-035e0834-514a-4137-a078-be471a61f692 None None] Updating volume stats {{(pid=75125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 23:42:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:42:05 devstack sudo[83391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 23:42:05 devstack sudo[83391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:42:05 devstack sudo[83391]: pam_unix(sudo:session): session closed for user root Sep 18 23:42:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:42:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:42:05 devstack sudo[83394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:42:05 devstack sudo[83394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:42:06 devstack sudo[83394]: pam_unix(sudo:session): session closed for user root Sep 18 23:42:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:42:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:42:06 devstack sudo[83400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:42:06 devstack sudo[83400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:42:06 devstack sudo[83400]: pam_unix(sudo:session): session closed for user root Sep 18 23:42:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:42:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:42:06 devstack sudo[83403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:42:06 devstack sudo[83403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:42:06 devstack sudo[83403]: pam_unix(sudo:session): session closed for user root Sep 18 23:42:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:42:06 devstack cinder-volume[75125]: DEBUG cinder.manager [None req-035e0834-514a-4137-a078-be471a61f692 None None] Notifying Schedulers of capabilities ... {{(pid=75125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:43:05 devstack cinder-volume[75125]: DEBUG oslo_service.periodic_task [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:43:05 devstack cinder-volume[75125]: DEBUG cinder.volume.drivers.lvm [None req-035e0834-514a-4137-a078-be471a61f692 None None] Updating volume stats {{(pid=75125) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 23:43:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:05 devstack sudo[84618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 23:43:05 devstack sudo[84618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:43:05 devstack sudo[84618]: pam_unix(sudo:session): session closed for user root Sep 18 23:43:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:05 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:05 devstack sudo[84621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:43:05 devstack sudo[84621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:43:06 devstack sudo[84621]: pam_unix(sudo:session): session closed for user root Sep 18 23:43:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:06 devstack sudo[84624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 23:43:06 devstack sudo[84624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:43:06 devstack sudo[84624]: pam_unix(sudo:session): session closed for user root Sep 18 23:43:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:06 devstack sudo[84628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 23:43:06 devstack sudo[84628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:43:06 devstack sudo[84628]: pam_unix(sudo:session): session closed for user root Sep 18 23:43:06 devstack cinder-volume[75125]: DEBUG oslo_concurrency.processutils [None req-035e0834-514a-4137-a078-be471a61f692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75125) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:06 devstack cinder-volume[75125]: DEBUG cinder.manager [None req-035e0834-514a-4137-a078-be471a61f692 None None] Notifying Schedulers of capabilities ... {{(pid=75125) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:43:06 devstack cinder-volume[75125]: DEBUG oslo_service.periodic_task [None req-035e0834-514a-4137-a078-be471a61f692 None None] Running periodic task VolumeManager._thread_info {{(pid=75125) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:43:06 devstack cinder-volume[75125]: DEBUG cinder.volume.manager [None req-035e0834-514a-4137-a078-be471a61f692 None None] thread count: 6 {{(pid=75125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:43:06 devstack cinder-volume[75125]: DEBUG cinder.volume.manager [None req-035e0834-514a-4137-a078-be471a61f692 None None] thread info: [<_MainThread(MainThread, started 128937655582848)>, , , , , ] {{(pid=75125) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:43:15 devstack cinder-volume[75125]: DEBUG dbcounter [-] [75125] Writing DB stats cinder:SELECT=1 {{(pid=75125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:43:15 devstack cinder-volume[75125]: DEBUG dbcounter [-] [75125] Writing DB stats cinder:UPDATE=1 {{(pid=75125) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:43:24 devstack cinder-volume[74974]: INFO oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Caught SIGTERM, stopping children Sep 18 23:43:24 devstack cinder-volume[74974]: DEBUG oslo_concurrency.lockutils [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Acquiring lock "singleton_lock" {{(pid=74974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 23:43:24 devstack cinder-volume[74974]: DEBUG oslo_concurrency.lockutils [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Acquired lock "singleton_lock" {{(pid=74974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 23:43:24 devstack cinder-volume[74974]: DEBUG oslo_concurrency.lockutils [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Releasing lock "singleton_lock" {{(pid=74974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 23:43:24 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Stop services. {{(pid=74974) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 18 23:43:24 devstack cinder-volume[74974]: DEBUG oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Killing children. {{(pid=74974) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 18 23:43:24 devstack cinder-volume[74974]: INFO oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Waiting on 1 children to exit Sep 18 23:43:24 devstack cinder-volume[75125]: DEBUG oslo_concurrency.lockutils [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Acquiring lock "singleton_lock" {{(pid=75125) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 23:43:24 devstack cinder-volume[75125]: DEBUG oslo_concurrency.lockutils [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Acquired lock "singleton_lock" {{(pid=75125) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 23:43:24 devstack cinder-volume[75125]: DEBUG oslo_concurrency.lockutils [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Releasing lock "singleton_lock" {{(pid=75125) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 23:43:24 devstack cinder-volume[75125]: WARNING amqp [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 23:43:24 devstack cinder-volume[75125]: WARNING amqp [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 23:43:24 devstack cinder-volume[74974]: INFO oslo_service.backend._eventlet.service [None req-0c7096e0-3a5e-44ba-96be-2a8c971119ad None None] Child 75125 exited with status 0 Sep 18 23:43:24 devstack cinder-volume[85122]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 18 23:43:24 devstack cinder-volume[85122]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 18 23:43:24 devstack cinder-volume[85122]: we strongly recommend against using it for new projects. Sep 18 23:43:24 devstack cinder-volume[85122]: If you are already using Eventlet, we recommend migrating to a different Sep 18 23:43:24 devstack cinder-volume[85122]: framework. For more detail see Sep 18 23:43:24 devstack cinder-volume[85122]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 18 23:43:24 devstack cinder-volume[85122]: import eventlet # noqa Sep 18 23:43:26 devstack cinder-volume[85122]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 23:43:26 devstack cinder-volume[85122]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 23:43:26 devstack cinder-volume[85122]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 23:43:27 devstack cinder-volume[85122]: INFO dbcounter [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Registered counter for database cinder Sep 18 23:43:27 devstack cinder-volume[85122]: DEBUG oslo_db.sqlalchemy.engines [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG dbcounter [-] [85122] Writer thread running {{(pid=85122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 23:43:28 devstack cinder-volume[85122]: INFO cinder.rpc [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 18 23:43:28 devstack cinder-volume[85122]: INFO cinder.rpc [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_db.sqlalchemy.engines [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:43:28 devstack cinder-volume[85122]: INFO cinder.volume.manager [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Determined volume DB was empty at startup. Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG cinder.volume.manager [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85122) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 18 23:43:28 devstack cinder-volume[85122]: INFO cinder.volume.manager [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 18 23:43:28 devstack cinder-volume[85122]: WARNING stevedore.named [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 23:43:28 devstack cinder-volume[85122]: WARNING castellan.key_manager [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 23:43:28 devstack cinder-volume[85122]: WARNING cinder.keymgr.conf_key_mgr [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 23:43:28 devstack cinder-volume[85122]: INFO cinder.volume.manager [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_db.sqlalchemy.engines [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:43:28 devstack cinder-volume[85122]: INFO oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Starting 1 workers Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Started child 85337 {{(pid=85122) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Full set of CONF: {{(pid=85122) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] ******************************************************************************** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Configuration options gathered from: {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] ================================================================================ {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] allow_availability_zone_fallback = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] allow_compression_on_image_upload = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] allowed_direct_url_schemes = [] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] api_rate_limit = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] auth_strategy = keystone {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_availability_zone = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_host = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_name = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_stats_polling_interval = 60 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backup_api_class = cinder.backup.api.API {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backup_name_template = backup-%s {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backup_use_same_host = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backup_use_temp_snapshot = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] chap_password = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] chap_username = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85337]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cinder_internal_tenant_project_id = 484f811eee33454296996ba127f9a10f {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cinder_internal_tenant_user_id = 9f09d24b8ec345718361b045d4c10b2c {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cluster = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] compression_format = gzip {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] compute_api_class = cinder.compute.nova.API {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] config_dir = [] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] config_source = [] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] control_exchange = openstack {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] debug = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] default_availability_zone = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] default_group_type = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] default_volume_type = QuobyteHD {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] disk_geometry = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] driver_client_cert = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] driver_client_cert_key = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] driver_data_namespace = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] driver_ssl_cert_path = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] driver_ssl_cert_verify = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] driver_use_ssl = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] enable_new_services = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] enable_unsupported_driver = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] enabled_backends = ['QuobyteHD'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] enforce_multipath_for_image_xfer = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] filter_function = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance_api_insecure = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance_api_servers = ['http://192.168.122.119/image'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance_api_ssl_compression = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance_ca_certificates_file = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance_catalog_info = image:glance:publicURL {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance_certfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance_keyfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance_num_retries = 3 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance_request_timeout = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] goodness_function = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] graceful_shutdown_timeout = 5 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] group_api_class = cinder.group.api.API {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] host = devstack {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] image_compress_on_upload = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] image_conversion_address_space_limit = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] image_conversion_cpu_limit = 60 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] image_conversion_disable = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] image_introspection_address_space_limit = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] image_introspection_cpu_limit = 60 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] image_upload_use_cinder_backend = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] image_upload_use_internal_tenant = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] image_volume_cache_enabled = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] image_volume_cache_max_count = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] image_volume_cache_max_size_gb = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] init_host_max_objects_retrieval = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] instance_format = [instance: %(uuid)s] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] iscsi_target_flags = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] iscsi_write_cache = on {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] iser_helper = tgtadm {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] iser_ip_address = 192.168.122.119 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] iser_port = 3260 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] log_color = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] log_config_append = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] log_dir = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] log_file = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] log_options = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] log_rotate_interval = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] log_rotate_interval_type = days {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] log_rotation_type = none {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] max_age = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] max_logfile_count = 30 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] max_logfile_size_mb = 200 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] max_over_subscription_ratio = 20.0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] message_reap_interval = 86400 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] message_ttl = 2592000 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] migration_create_volume_timeout_secs = 300 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] monkey_patch = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] monkey_patch_modules = [] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] my_ip = 192.168.122.119 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] no_snapshot_gb_quota = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] num_iser_scan_tries = 3 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] num_shell_tries = 3 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] num_volume_device_scan_tries = 3 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] nvmeof_conn_info_version = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] nvmet_ns_id = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] nvmet_port_id = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] osapi_max_limit = 1000 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] osapi_volume_ext_list = [] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] osapi_volume_listen_port = 8776 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] osapi_volume_use_ssl = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] osapi_volume_workers = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] per_volume_size_limit = -1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] periodic_fuzzy_delay = 60 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] periodic_interval = 60 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] public_endpoint = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] publish_errors = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] quota_backup_gigabytes = 1000 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] quota_backups = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] quota_gigabytes = 1000 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] quota_groups = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] quota_snapshots = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] quota_volumes = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] rate_limit_burst = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] rate_limit_except_level = CRITICAL {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] rate_limit_interval = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] reinit_driver_count = 3 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] replication_device = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] report_discard_supported = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] report_interval = 120 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] reservation_clean_interval = 86400 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] reservation_expire = 86400 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] reserved_image_namespaces = [] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] reserved_percentage = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] rpc_response_timeout = 120 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] run_external_periodic_tasks = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] scst_target_driver = iscsi {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] scst_target_iqn_name = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_down_time = 720 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] shell_completion = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] snapshot_name_template = snapshot-%s {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] split_loggers = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] state_path = /opt/stack/data/cinder {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] storage_availability_zone = nova {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85337]: INFO cinder.volume.manager [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Starting volume driver QuobyteDriver (1.2.1) Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] storage_protocol = iSCSI {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] syslog_log_facility = LOG_USER {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] target_helper = lioadm {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] target_ip_address = 192.168.122.119 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] target_port = 3260 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] target_protocol = iscsi {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] target_secondary_ip_addresses = [] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.remotefs [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85337) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] trace_flags = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] transport_url = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] until_refresh = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] use_chap_auth = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] use_default_quota_class = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] use_journal = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] use_json = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] use_multipath_for_image_xfer = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] use_stderr = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] use_syslog = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] verify_glance_signatures = enabled {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volume_api_class = cinder.volume.api.API {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volume_backend_name = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volume_clear = zero {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volume_clear_ionice = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volume_clear_size = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volume_copy_bps_limit = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volume_dd_blocksize = 1M {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volume_name_template = volume-%s {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volume_service_inithost_offload = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volume_usage_audit_period = month {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] zoning_mode = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_concurrency.disable_process_locking = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.auth_section = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.auth_type = password {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.auth_version = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.cache = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.certfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.include_service_catalog = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.insecure = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.interface = public {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.keyfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_password = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcache_username = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.region_name = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.service_type = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.119/identity {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.backend = dogpile.cache.null {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.backend_argument = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.backend_expiration_time = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.config_prefix = cache.oslo {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.debug_cache_backend = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.enable_retry_client = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.enable_socket_keepalive = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.enabled = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.expiration_time = 600 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.hashclient_retry_attempts = 2 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.memcache_dead_retry = 300 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.memcache_pool_maxsize = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.memcache_sasl_enabled = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.password = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.proxies = [] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.redis_db = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.redis_server = localhost:6379 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.retry_attempts = 2 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.retry_delay = 0.0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.socket_keepalive_count = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.socket_keepalive_idle = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.socket_keepalive_interval = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.socket_timeout = 1.0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.tls_allowed_ciphers = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.tls_cafile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.tls_certfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.tls_enabled = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.tls_keyfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cache.username = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] coordination.backend_url = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.asyncio_connection = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.asyncio_slave_connection = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.backend = sqlalchemy {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.connection = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.connection_debug = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.connection_parameters = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.connection_recycle_time = 3600 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.connection_trace = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.db_inc_retry_interval = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.db_max_retries = 20 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.db_max_retry_interval = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.db_retry_interval = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.max_overflow = 50 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.max_pool_size = 5 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.max_retries = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.mysql_wsrep_sync_wait = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.pool_timeout = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.retry_interval = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.slave_connection = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.sqlite_synchronous = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.synchronous_reader = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] database.use_db_reconnect = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_tracing.insecure = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler.connection_string = messaging:// {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler.enabled = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler.es_doc_type = notification {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler.es_scroll_size = 10000 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler.es_scroll_time = 2m {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler.filter_error_trace = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler.hmac_keys = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler.sentinel_service_name = mymaster {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler.socket_timeout = 0.1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler.trace_requests = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler.trace_sqlalchemy = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler_jaeger.process_tags = {} {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler_jaeger.service_name_prefix = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] profiler_otlp.service_name_prefix = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_policy.enforce_new_defaults = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_policy.policy_default_rule = default {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_policy.policy_file = policy.yaml {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] privsep_osbrick.group = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] privsep_osbrick.helper_command = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] privsep_osbrick.user = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cinder_sys_admin.group = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cinder_sys_admin.helper_command = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] cinder_sys_admin.user = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85337) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 18 23:43:28 devstack cinder-volume[85337]: WARNING cinder.volume.drivers.quobyte [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 18 23:43:28 devstack cinder-volume[85337]: WARNING cinder.volume.drivers.quobyte [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_user.auth_section = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_user.auth_type = password {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_user.cafile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_user.certfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_user.collect_timing = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_user.insecure = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Running cmd (subprocess): mount.quobyte {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_user.keyfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_user.send_service_user_token = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_user.split_loggers = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_user.timeout = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_user.tls_ciphers = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] service_user.tls_min_version = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance.auth_section = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance.auth_type = password {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance.certfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance.collect_timing = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance.insecure = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance.keyfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance.region_name = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance.split_loggers = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance.timeout = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance.tls_ciphers = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] glance.tls_min_version = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.backend_availability_zone = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.chap_password = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.chap_username = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.disk_geometry = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.driver_client_cert = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.driver_client_cert_key = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.driver_data_namespace = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.driver_use_ssl = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.extra_capabilities = {} {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.filter_function = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.goodness_function = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.iscsi_target_flags = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.iscsi_write_cache = on {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.iser_helper = tgtadm {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.iser_ip_address = 192.168.122.119 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.iser_port = 3260 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nas_host = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nas_login = admin {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nas_mount_options = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nas_password = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nas_private_key = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nas_share_path = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.num_shell_tries = 3 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.quobyte_volume_url = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.replication_device = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.report_discard_supported = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.reserved_percentage = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.target_helper = tgtadm {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.target_ip_address = 192.168.122.119 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.target_port = 3260 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.target_protocol = iscsi {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.trace_flags = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.unique_fqdn_network = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.use_chap_auth = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.volume_backend_name = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.volume_clear = zero {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.volume_clear_ionice = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.volume_clear_size = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_reports.file_event_handler = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_reports.log_dir = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.backend_availability_zone = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.backend_host = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.chap_password = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.chap_username = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.chiscsi_conf = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.disk_geometry = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.driver_client_cert = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.driver_data_namespace = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.driver_use_ssl = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.extra_capabilities = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.filter_function = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.goodness_function = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.iser_helper = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.iser_ip_address = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.iser_port = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.iser_target_prefix = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nas_host = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nas_login = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nas_mount_options = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nas_password = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nas_private_key = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nas_share_path = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nas_ssh_port = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.num_shell_tries = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.nvmet_port_id = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.replication_device = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.report_discard_supported = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.reserved_percentage = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.scst_target_driver = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.storage_protocol = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.target_helper = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.target_ip_address = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.target_port = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.target_prefix = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.target_protocol = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.trace_flags = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.use_chap_auth = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.volume_clear = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.volume_clear_size = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] QuobyteHD.volumes_dir = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.ssl = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_notifications.driver = [] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_notifications.retry = -1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] key_manager.fixed_key = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.barbican_api_version = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.barbican_endpoint = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.barbican_endpoint_type = public {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.barbican_region_name = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.cafile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.certfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.collect_timing = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.insecure = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.keyfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.number_of_retries = 60 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.retry_delay = 1 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.send_service_user_token = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.split_loggers = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.timeout = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.tls_ciphers = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.tls_min_version = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.verify_ssl = True {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican.verify_ssl_path = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican_service_user.auth_section = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican_service_user.auth_type = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican_service_user.cafile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican_service_user.certfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican_service_user.collect_timing = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican_service_user.insecure = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican_service_user.keyfile = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican_service_user.split_loggers = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican_service_user.timeout = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican_service_user.tls_ciphers = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] barbican_service_user.tls_min_version = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.approle_role_id = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.approle_secret_id = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.auth_method = approle {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.auth_path = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.kv_mountpoint = secret {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.kv_path = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.kv_version = 2 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.namespace = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.root_token_id = **** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.ssl_ca_crt_file = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.timeout = 60.0 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.token_file = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.token_role = None {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.use_ssl = False {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:28 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] ******************************************************************************** {{(pid=85122) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 18 23:43:28 devstack quobyte-client[85342]: Reading configuration file: /etc/quobyte/client.cfg Sep 18 23:43:28 devstack quobyte-client[85342]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 18 23:43:28 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] CMD "mount.quobyte" returned: 1 in 0.130s {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:28 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:43:28 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:43:28 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85337) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:43:28 devstack cinder-volume[85337]: INFO cinder.volume.drivers.quobyte [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b ... Sep 18 23:43:28 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 -c /etc/quobyte/client-cinder.cfg {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:28 devstack sudo[85343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 -c /etc/quobyte/client-cinder.cfg Sep 18 23:43:28 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:43:29 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.394s {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:29 devstack cinder-volume[85337]: INFO cinder.volume.drivers.quobyte [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b succeeded Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85337) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.423s {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:29 devstack sudo[85442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:43:29 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:43:29 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.246s {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:29 devstack cinder-volume[85337]: INFO cinder.volume.driver [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Driver hasn't implemented _init_vendor_properties() Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG cinder.volume.driver [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6891326904297, 'free_capacity_gb': 1775.6891326904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85337) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_db.sqlalchemy.engines [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG dbcounter [-] [85337] Writer thread running {{(pid=85337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG cinder.db.api [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Building query based on filter {{(pid=85337) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG cinder.image.image_utils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85337) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 18 23:43:29 devstack cinder-volume[85337]: INFO cinder.keymgr.migration [None req-68d8f6bf-2e86-4230-b52a-8c1721eb1100 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85337) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85337) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:29 devstack sudo[85445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:43:29 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:43:29 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.240s {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG cinder.manager [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Notifying Schedulers of capabilities ... {{(pid=85337) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:43:29 devstack cinder-volume[85337]: INFO cinder.volume.manager [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Driver initialization completed successfully. Sep 18 23:43:29 devstack cinder-volume[85337]: INFO cinder.manager [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Initiating service 3 cleanup Sep 18 23:43:29 devstack cinder-volume[85337]: INFO cinder.manager [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Service 3 cleanup completed. Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG cinder.service [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Creating RPC server for service cinder-volume {{(pid=85337) start /opt/stack/cinder/cinder/service.py:231}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG cinder.service [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85337) start /opt/stack/cinder/cinder/service.py:237}} Sep 18 23:43:29 devstack cinder-volume[85337]: INFO cinder.volume.manager [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85337) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85337) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:43:29 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:29 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:43:29 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:43:30 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Sep 18 23:43:30 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.249s {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:30 devstack cinder-volume[85337]: INFO cinder.volume.manager [None req-c15aab1a-0723-4dcf-8f84-21985d3206bc None None] Driver post RPC initialization completed successfully. Sep 18 23:43:34 devstack cinder-volume[85122]: INFO oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Caught SIGTERM, stopping children Sep 18 23:43:34 devstack cinder-volume[85122]: DEBUG oslo_concurrency.lockutils [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Acquiring lock "singleton_lock" {{(pid=85122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 23:43:34 devstack cinder-volume[85122]: DEBUG oslo_concurrency.lockutils [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Acquired lock "singleton_lock" {{(pid=85122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 23:43:34 devstack cinder-volume[85122]: DEBUG oslo_concurrency.lockutils [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Releasing lock "singleton_lock" {{(pid=85122) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 23:43:34 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Stop services. {{(pid=85122) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 18 23:43:34 devstack cinder-volume[85122]: DEBUG oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Killing children. {{(pid=85122) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 18 23:43:34 devstack cinder-volume[85122]: INFO oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Waiting on 1 children to exit Sep 18 23:43:38 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Acquiring lock "singleton_lock" {{(pid=85337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 23:43:38 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Acquired lock "singleton_lock" {{(pid=85337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 23:43:38 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Releasing lock "singleton_lock" {{(pid=85337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 23:43:38 devstack cinder-volume[85337]: WARNING amqp [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 23:43:38 devstack cinder-volume[85337]: WARNING amqp [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 23:43:38 devstack cinder-volume[85122]: INFO oslo_service.backend._eventlet.service [None req-72096a41-3ecc-4664-a9db-8d1e186b5254 None None] Child 85337 exited with status 0 Sep 18 23:43:38 devstack cinder-volume[85650]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 18 23:43:38 devstack cinder-volume[85650]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 18 23:43:38 devstack cinder-volume[85650]: we strongly recommend against using it for new projects. Sep 18 23:43:38 devstack cinder-volume[85650]: If you are already using Eventlet, we recommend migrating to a different Sep 18 23:43:38 devstack cinder-volume[85650]: framework. For more detail see Sep 18 23:43:38 devstack cinder-volume[85650]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 18 23:43:38 devstack cinder-volume[85650]: import eventlet # noqa Sep 18 23:43:41 devstack cinder-volume[85650]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85650) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 23:43:41 devstack cinder-volume[85650]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85650) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 23:43:41 devstack cinder-volume[85650]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85650) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 23:43:42 devstack cinder-volume[85650]: INFO dbcounter [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] Registered counter for database cinder Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_db.sqlalchemy.engines [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG dbcounter [-] [85650] Writer thread running {{(pid=85650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 23:43:42 devstack cinder-volume[85650]: INFO cinder.rpc [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 18 23:43:42 devstack cinder-volume[85650]: INFO cinder.rpc [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_db.sqlalchemy.engines [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:43:42 devstack cinder-volume[85650]: INFO cinder.volume.manager [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] Determined volume DB was empty at startup. Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG cinder.volume.manager [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85650) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 18 23:43:42 devstack cinder-volume[85650]: WARNING stevedore.named [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 23:43:42 devstack cinder-volume[85650]: WARNING castellan.key_manager [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 23:43:42 devstack cinder-volume[85650]: WARNING cinder.keymgr.conf_key_mgr [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 23:43:42 devstack cinder-volume[85650]: INFO cinder.volume.manager [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_db.sqlalchemy.engines [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:43:42 devstack cinder-volume[85650]: INFO oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] Starting 1 workers Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] Started child 85963 {{(pid=85650) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] Full set of CONF: {{(pid=85650) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] ******************************************************************************** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] Configuration options gathered from: {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] ================================================================================ {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 18 23:43:42 devstack cinder-volume[85963]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] allow_availability_zone_fallback = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] allow_compression_on_image_upload = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] allowed_direct_url_schemes = [] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] api_rate_limit = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] auth_strategy = keystone {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_availability_zone = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_host = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_name = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_stats_polling_interval = 60 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backup_api_class = cinder.backup.api.API {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backup_name_template = backup-%s {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backup_use_same_host = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backup_use_temp_snapshot = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] chap_password = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] chap_username = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cinder_internal_tenant_project_id = 484f811eee33454296996ba127f9a10f {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cinder_internal_tenant_user_id = 9f09d24b8ec345718361b045d4c10b2c {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cluster = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] compression_format = gzip {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] compute_api_class = cinder.compute.nova.API {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] config_dir = [] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] config_source = [] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] control_exchange = openstack {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] debug = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] default_availability_zone = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] default_group_type = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] default_volume_type = QuobyteHD {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] disk_geometry = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] driver_client_cert = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] driver_client_cert_key = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] driver_data_namespace = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] driver_ssl_cert_path = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] driver_ssl_cert_verify = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] driver_use_ssl = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] enable_new_services = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] enable_unsupported_driver = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] enabled_backends = ['QuobyteHD'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] enforce_multipath_for_image_xfer = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] filter_function = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance_api_insecure = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance_api_servers = ['http://192.168.122.119/image'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance_api_ssl_compression = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance_ca_certificates_file = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance_catalog_info = image:glance:publicURL {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance_certfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance_keyfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance_num_retries = 3 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance_request_timeout = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] goodness_function = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] graceful_shutdown_timeout = 5 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] group_api_class = cinder.group.api.API {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] host = devstack {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] image_compress_on_upload = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] image_conversion_address_space_limit = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] image_conversion_cpu_limit = 60 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] image_conversion_disable = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] image_introspection_address_space_limit = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] image_introspection_cpu_limit = 60 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] image_upload_use_cinder_backend = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] image_upload_use_internal_tenant = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] image_volume_cache_enabled = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] image_volume_cache_max_count = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] image_volume_cache_max_size_gb = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] init_host_max_objects_retrieval = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] instance_format = [instance: %(uuid)s] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] iscsi_target_flags = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] iscsi_write_cache = on {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] iser_helper = tgtadm {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] iser_ip_address = 192.168.122.119 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] iser_port = 3260 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] log_color = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] log_config_append = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] log_dir = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] log_file = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] log_options = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] log_rotate_interval = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] log_rotate_interval_type = days {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] log_rotation_type = none {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85963) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] max_age = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] max_logfile_count = 30 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] max_logfile_size_mb = 200 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] max_over_subscription_ratio = 20.0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] message_reap_interval = 86400 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] message_ttl = 2592000 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] migration_create_volume_timeout_secs = 300 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] monkey_patch = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] monkey_patch_modules = [] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] my_ip = 192.168.122.119 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] no_snapshot_gb_quota = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] num_iser_scan_tries = 3 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] num_shell_tries = 3 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] num_volume_device_scan_tries = 3 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] nvmeof_conn_info_version = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] nvmet_ns_id = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] nvmet_port_id = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] osapi_max_limit = 1000 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] osapi_volume_ext_list = [] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] osapi_volume_listen = 0.0.0.0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] osapi_volume_listen_port = 8776 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] osapi_volume_use_ssl = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] osapi_volume_workers = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] per_volume_size_limit = -1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] periodic_fuzzy_delay = 60 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] periodic_interval = 60 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] project_id_regex = [0-9a-f\-]+ {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] public_endpoint = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] publish_errors = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] quota_backup_gigabytes = 1000 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] quota_backups = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] quota_gigabytes = 1000 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] quota_groups = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] quota_snapshots = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] quota_volumes = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] rate_limit_burst = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] rate_limit_except_level = CRITICAL {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] rate_limit_interval = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] reinit_driver_count = 3 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] replication_device = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] report_discard_supported = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] report_interval = 120 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] reservation_clean_interval = 86400 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] reservation_expire = 86400 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] reserved_image_namespaces = [] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] reserved_percentage = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] rpc_response_timeout = 120 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] run_external_periodic_tasks = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] scst_target_driver = iscsi {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] scst_target_iqn_name = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_down_time = 720 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] shell_completion = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] snapshot_name_template = snapshot-%s {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] split_loggers = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] state_path = /opt/stack/data/cinder {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] storage_availability_zone = nova {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:42 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] storage_protocol = iSCSI {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] syslog_log_facility = LOG_USER {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] target_helper = lioadm {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] target_ip_address = 192.168.122.119 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] target_port = 3260 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] target_protocol = iscsi {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] target_secondary_ip_addresses = [] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] trace_flags = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] transfer_api_class = cinder.transfer.api.API {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] transport_url = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] until_refresh = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] use_chap_auth = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] use_default_quota_class = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] use_journal = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] use_json = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] use_multipath_for_image_xfer = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] use_stderr = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] use_syslog = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] verify_glance_signatures = enabled {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volume_api_class = cinder.volume.api.API {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volume_backend_name = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volume_clear = zero {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volume_clear_ionice = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volume_clear_size = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volume_copy_bps_limit = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volume_dd_blocksize = 1M {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volume_name_template = volume-%s {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volume_service_inithost_offload = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volume_usage_audit_period = month {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] zoning_mode = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_concurrency.disable_process_locking = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.auth_section = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.auth_type = password {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.auth_version = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.cache = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.certfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.delay_auth_decision = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.http_connect_timeout = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.include_service_catalog = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.insecure = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.interface = public {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.keyfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_password = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcache_username = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.region_name = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.service_token_roles_required = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.service_type = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.token_cache_time = 300 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.119/identity {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.backend = dogpile.cache.null {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.backend_argument = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.backend_expiration_time = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.config_prefix = cache.oslo {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.debug_cache_backend = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.enable_retry_client = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.enable_socket_keepalive = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.enabled = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.expiration_time = 600 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.hashclient_retry_attempts = 2 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.memcache_dead_retry = 300 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.memcache_pool_maxsize = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.memcache_sasl_enabled = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.password = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.proxies = [] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.redis_db = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.redis_sentinel_service_name = mymaster {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.redis_server = localhost:6379 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.retry_attempts = 2 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.retry_delay = 0.0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.socket_keepalive_count = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.socket_keepalive_idle = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.socket_keepalive_interval = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.socket_timeout = 1.0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.tls_allowed_ciphers = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.tls_cafile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.tls_certfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.tls_enabled = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.tls_keyfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cache.username = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] coordination.backend_url = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.asyncio_connection = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.asyncio_slave_connection = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.backend = sqlalchemy {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.connection = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.connection_debug = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.connection_parameters = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.connection_recycle_time = 3600 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.connection_trace = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.db_inc_retry_interval = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.db_max_retries = 20 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.db_max_retry_interval = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.db_retry_interval = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.max_overflow = 50 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.max_pool_size = 5 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.max_retries = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.mysql_wsrep_sync_wait = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.pool_timeout = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.retry_interval = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.slave_connection = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.sqlite_synchronous = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.synchronous_reader = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] database.use_db_reconnect = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_tracing.insecure = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler.connection_string = messaging:// {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler.enabled = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler.es_doc_type = notification {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler.es_scroll_size = 10000 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler.es_scroll_time = 2m {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler.filter_error_trace = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler.hmac_keys = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler.sentinel_service_name = mymaster {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler.socket_timeout = 0.1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler.trace_requests = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler.trace_sqlalchemy = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler_jaeger.process_tags = {} {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler_jaeger.service_name_prefix = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] profiler_otlp.service_name_prefix = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_policy.enforce_new_defaults = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_policy.policy_default_rule = default {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_policy.policy_file = policy.yaml {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_policy.remote_timeout = 60.0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] privsep_osbrick.group = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] privsep_osbrick.helper_command = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] privsep_osbrick.user = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cinder_sys_admin.group = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cinder_sys_admin.helper_command = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] cinder_sys_admin.user = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_user.auth_section = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_user.auth_type = password {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_user.cafile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_user.certfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_user.collect_timing = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_user.insecure = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_user.keyfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_user.send_service_user_token = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_user.split_loggers = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_user.timeout = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_user.tls_ciphers = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] service_user.tls_min_version = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance.auth_section = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance.auth_type = password {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance.certfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance.collect_timing = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance.insecure = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance.keyfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance.region_name = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance.split_loggers = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance.timeout = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance.tls_ciphers = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] glance.tls_min_version = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.backend_availability_zone = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.chap_password = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.chap_username = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.disk_geometry = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.driver_client_cert = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.driver_client_cert_key = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.driver_data_namespace = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.driver_use_ssl = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.enable_unsupported_driver = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.extra_capabilities = {} {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.filter_function = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.goodness_function = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.iscsi_target_flags = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.iscsi_write_cache = on {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.iser_helper = tgtadm {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.iser_ip_address = 192.168.122.119 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.iser_port = 3260 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nas_host = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nas_login = admin {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nas_mount_options = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nas_password = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nas_private_key = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nas_share_path = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nas_ssh_port = 22 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.num_shell_tries = 3 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.nvmet_port_id = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.quobyte_client_cfg = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.quobyte_volume_url = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.replication_device = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.report_discard_supported = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.reserved_percentage = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.scst_target_driver = iscsi {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.scst_target_iqn_name = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.storage_protocol = iSCSI {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.target_helper = tgtadm {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.target_ip_address = 192.168.122.119 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.target_port = 3260 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.target_protocol = iscsi {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.trace_flags = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.unique_fqdn_network = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.use_chap_auth = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.volume_backend_name = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.volume_clear = zero {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.volume_clear_ionice = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.volume_clear_size = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_reports.file_event_handler = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_reports.log_dir = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.backend_availability_zone = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.backend_host = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.chap_password = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.chap_username = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.chiscsi_conf = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.disk_geometry = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.driver_client_cert = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85963) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 18 23:43:43 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.quobyte [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.driver_client_cert_key = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.driver_data_namespace = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.driver_use_ssl = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.extra_capabilities = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.filter_function = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.goodness_function = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.quobyte [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.iscsi_target_flags = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Running cmd (subprocess): mount.quobyte {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.iscsi_write_cache = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.iser_helper = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.iser_ip_address = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.iser_port = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.iser_target_prefix = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nas_host = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nas_login = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nas_mount_options = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nas_password = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nas_private_key = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nas_share_path = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nas_ssh_port = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.num_shell_tries = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nvmet_ns_id = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.nvmet_port_id = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.replication_device = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.report_discard_supported = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.reserved_percentage = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.scst_target_driver = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.storage_protocol = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.target_helper = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.target_ip_address = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.target_port = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.target_prefix = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.target_protocol = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.trace_flags = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.unique_fqdn_network = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.use_chap_auth = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.volume_clear = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.volume_clear_ionice = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.volume_clear_size = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] QuobyteHD.volumes_dir = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.ssl = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.ssl_version = {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_notifications.driver = [] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_notifications.retry = -1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] oslo_messaging_notifications.transport_url = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] key_manager.fixed_key = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.barbican_api_version = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.barbican_endpoint = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.barbican_endpoint_type = public {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.barbican_region_name = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.cafile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.certfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.collect_timing = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.insecure = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.keyfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.number_of_retries = 60 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.retry_delay = 1 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.send_service_user_token = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.split_loggers = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.timeout = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.tls_ciphers = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.tls_min_version = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.verify_ssl = True {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican.verify_ssl_path = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican_service_user.auth_section = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican_service_user.auth_type = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican_service_user.cafile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican_service_user.certfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican_service_user.collect_timing = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican_service_user.insecure = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican_service_user.keyfile = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican_service_user.split_loggers = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican_service_user.timeout = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican_service_user.tls_ciphers = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] barbican_service_user.tls_min_version = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.approle_role_id = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.approle_secret_id = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.auth_method = approle {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.auth_path = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.kv_mountpoint = secret {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.kv_path = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.kv_version = 2 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.namespace = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.root_token_id = **** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.ssl_ca_crt_file = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.timeout = 60.0 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.token_file = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.token_role = None {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.use_ssl = False {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 23:43:43 devstack cinder-volume[85650]: DEBUG oslo_service.backend._eventlet.service [None req-79b0a3d6-b60e-4e55-913c-d12a708b017d None None] ******************************************************************************** {{(pid=85650) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 18 23:43:43 devstack quobyte-client[85970]: Reading configuration file: /etc/quobyte/client.cfg Sep 18 23:43:43 devstack quobyte-client[85970]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] CMD "mount.quobyte" returned: 1 in 0.092s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:43 devstack sudo[85971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:43:43 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:43:43 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:43 devstack cinder-volume[85963]: INFO cinder.volume.driver [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Driver hasn't implemented _init_vendor_properties() Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.volume.driver [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6891326904297, 'free_capacity_gb': 1775.6891326904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85963) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_db.sqlalchemy.engines [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writer thread running {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.db.api [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Building query based on filter {{(pid=85963) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85963) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:43 devstack cinder-volume[85963]: INFO cinder.keymgr.migration [None req-9cdb43f3-0170-48da-895b-0e79545223bb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 18 23:43:43 devstack sudo[85982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:43:43 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:43:43 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.236s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:43:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Driver initialization completed successfully. Sep 18 23:43:43 devstack cinder-volume[85963]: INFO cinder.manager [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Initiating service 3 cleanup Sep 18 23:43:43 devstack cinder-volume[85963]: INFO cinder.manager [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Service 3 cleanup completed. Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.service [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Creating RPC server for service cinder-volume {{(pid=85963) start /opt/stack/cinder/cinder/service.py:231}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.service [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85963) start /opt/stack/cinder/cinder/service.py:237}} Sep 18 23:43:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:43:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:43:43 devstack sudo[85995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:43:43 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:43:44 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root Sep 18 23:43:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:43:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dee2437c-fdb9-49d9-bf81-c2a2505baf50 None None] Driver post RPC initialization completed successfully. Sep 18 23:43:52 devstack cinder-volume[85650]: DEBUG dbcounter [-] [85650] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:43:53 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:43:54 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=3 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:44:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:44:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 6 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:44:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:44:40 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Flow 'volume_create_manager' (978f9524-5fa6-4fa9-a1f1-e417bca93653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1e6d60-761a-41db-8ef7-3577c04ccd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1e6d60-761a-41db-8ef7-3577c04ccd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1520253481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b175b213-c5aa-4490-9d8b-ca4cc0f8de16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0747f5a4747d443bac6278fd3e719b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:44:41Z,use_quota=True,user_id='08e73f751df84192951a01c7d0b9b019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba89cc8-d09e-4dc7-95c9-071a55f6fb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ba89cc8-d09e-4dc7-95c9-071a55f6fb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3aef8b-6211-484f-bac9-1c9fdd34ce6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3aef8b-6211-484f-bac9-1c9fdd34ce6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b175b213-c5aa-4490-9d8b-ca4cc0f8de16', 'volume_name': 'volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26664586-46c5-4e7e-8f35-eb27344b71e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26664586-46c5-4e7e-8f35-eb27344b71e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5185d68-9c45-4515-bd3a-2ff1640096ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:44:41 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Volume b175b213-c5aa-4490-9d8b-ca4cc0f8de16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16', 'volume_size': 1} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1520253481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b175b213-c5aa-4490-9d8b-ca4cc0f8de16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0747f5a4747d443bac6278fd3e719b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:44:41Z,use_quota=True,user_id='08e73f751df84192951a01c7d0b9b019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Creating volume b175b213-c5aa-4490-9d8b-ca4cc0f8de16 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:44:41 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:44:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:44:41 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16 1073741824 Sep 18 23:44:41 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:44:42 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Sep 18 23:44:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16 1073741824" returned: 0 in 1.231s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:44:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:44:43 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16 Sep 18 23:44:43 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:44:43 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Sep 18 23:44:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16" returned: 0 in 0.470s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:44:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:44:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:44:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5185d68-9c45-4515-bd3a-2ff1640096ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:44:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45bc516-bd06-4c07-b32e-9b4d38132d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:44:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Volume volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16 (b175b213-c5aa-4490-9d8b-ca4cc0f8de16): created successfully Sep 18 23:44:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b45bc516-bd06-4c07-b32e-9b4d38132d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:44:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Flow 'volume_create_manager' (978f9524-5fa6-4fa9-a1f1-e417bca93653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:44:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ed049189-2531-4970-b858-76d397e92089 tempest-TaggedAttachmentsTest-1927507382 None] Created volume successfully. Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Flow 'volume_create_manager' (b3a15725-03dc-4c3e-99d1-62ba8a280975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d27a13d-65af-42c1-b959-d753618f5263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d27a13d-65af-42c1-b959-d753618f5263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-530952234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e0edf9-1af0-4db6-8103-e3d6591dfa1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87aa5a7ebc094a1a9e700a6c521adfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:44:44Z,use_quota=True,user_id='1316318d09dc46f592a5ca9ce0b3292c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa97e5a-0d25-46b2-a5a7-be0175a6f7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa97e5a-0d25-46b2-a5a7-be0175a6f7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb768d0-83ad-4da4-b2f6-159d95ab9c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb768d0-83ad-4da4-b2f6-159d95ab9c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e0edf9-1af0-4db6-8103-e3d6591dfa1f', 'volume_name': 'volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4020c882-bd84-44a8-90a3-88b9b6e46524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4020c882-bd84-44a8-90a3-88b9b6e46524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4467252-49e6-4a28-8acc-ea8eee7a528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:44:44 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Volume 24e0edf9-1af0-4db6-8103-e3d6591dfa1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f', 'volume_size': 1} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-530952234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e0edf9-1af0-4db6-8103-e3d6591dfa1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87aa5a7ebc094a1a9e700a6c521adfbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:44:44Z,use_quota=True,user_id='1316318d09dc46f592a5ca9ce0b3292c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Creating volume 24e0edf9-1af0-4db6-8103-e3d6591dfa1f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:44:44 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:44:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:44:44 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f 1073741824 Sep 18 23:44:44 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:44:45 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Sep 18 23:44:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f 1073741824" returned: 0 in 1.042s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:44:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:44:46 devstack sudo[86898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f Sep 18 23:44:46 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:44:46 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root Sep 18 23:44:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f" returned: 0 in 0.970s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:44:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:44:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:44:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4467252-49e6-4a28-8acc-ea8eee7a528b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:44:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c9ade7-39d5-4b02-a22e-fd973327cf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:44:47 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Volume volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f (24e0edf9-1af0-4db6-8103-e3d6591dfa1f): created successfully Sep 18 23:44:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c9ade7-39d5-4b02-a22e-fd973327cf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:44:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Flow 'volume_create_manager' (b3a15725-03dc-4c3e-99d1-62ba8a280975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:44:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7e492529-10cd-4210-9af5-adc7fa8171d6 tempest-DeleteServersTestJSON-1257229554 None] Created volume successfully. Sep 18 23:44:56 devstack cinder-volume[85963]: WARNING py.warnings [req-48a6514d-8e95-4a12-aec9-c9ecb4af900f req-5e3b009e-776c-483d-a905-dece8c8ee2f0 tempest-DeleteServersTestJSON-1257229554 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 18 23:44:56 devstack cinder-volume[85963]: .first() Sep 18 23:44:56 devstack cinder-volume[85963]: Sep 18 23:44:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-48a6514d-8e95-4a12-aec9-c9ecb4af900f req-5e3b009e-776c-483d-a905-dece8c8ee2f0 tempest-DeleteServersTestJSON-1257229554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:44:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-48a6514d-8e95-4a12-aec9-c9ecb4af900f req-5e3b009e-776c-483d-a905-dece8c8ee2f0 tempest-DeleteServersTestJSON-1257229554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:44:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-48a6514d-8e95-4a12-aec9-c9ecb4af900f req-5e3b009e-776c-483d-a905-dece8c8ee2f0 tempest-DeleteServersTestJSON-1257229554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:44:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-48a6514d-8e95-4a12-aec9-c9ecb4af900f req-5e3b009e-776c-483d-a905-dece8c8ee2f0 tempest-DeleteServersTestJSON-1257229554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b814ba3-4976-45be-9ed2-4d9d18aa28c1', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:44:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-48a6514d-8e95-4a12-aec9-c9ecb4af900f req-5e3b009e-776c-483d-a905-dece8c8ee2f0 tempest-DeleteServersTestJSON-1257229554 None] attachment_update completed successfully. Sep 18 23:45:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-cdc87b23-3026-41f0-9ef0-8a1d3b75e84e req-53a35dc2-2a02-499d-a36d-561b9586fdb9 tempest-DeleteServersTestJSON-1257229554 None] Terminate volume connection completed successfully. Sep 18 23:45:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-cdc87b23-3026-41f0-9ef0-8a1d3b75e84e req-53a35dc2-2a02-499d-a36d-561b9586fdb9 tempest-DeleteServersTestJSON-1257229554 None] Deleting attachment 0b814ba3-4976-45be-9ed2-4d9d18aa28c1. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:45:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Acquiring lock "cinder-24e0edf9-1af0-4db6-8103-e3d6591dfa1f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:45:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Lock "cinder-24e0edf9-1af0-4db6-8103-e3d6591dfa1f-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:45:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Acquiring lock "cinder-quobyte-24e0edf9-1af0-4db6-8103-e3d6591dfa1f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:45:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Lock "cinder-quobyte-24e0edf9-1af0-4db6-8103-e3d6591dfa1f" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:45:08 devstack cinder-volume[85963]: INFO oslo.privsep.daemon [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2npzibfs/privsep.sock'] Sep 18 23:45:08 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2npzibfs/privsep.sock Sep 18 23:45:08 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:09 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 18 23:45:09 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 18 23:45:09 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 18 23:45:09 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: Sep 18 23:45:09 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 18 23:45:09 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 18 23:45:09 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 18 23:45:09 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: Sep 18 23:45:09 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 18 23:45:09 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:09 devstack cinder-volume[85963]: INFO oslo.privsep.daemon [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Spawned new privsep daemon via rootwrap Sep 18 23:45:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Accepted privsep connection to /tmp/tmp2npzibfs/privsep.sock {{(pid=85963) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 18 23:45:09 devstack cinder-volume[85963]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 18 23:45:09 devstack cinder-volume[85963]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 18 23:45:09 devstack cinder-volume[85963]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 18 23:45:09 devstack cinder-volume[85963]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87758 Sep 18 23:45:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ae859f-7aea-4542-9067-7da4222b38d3]: (2,) {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:45:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d7f28e-7bd2-4738-88b1-277a16aed330]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:45:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:10 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f Sep 18 23:45:10 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:10 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f" returned: 0 in 0.743s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:10 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f Sep 18 23:45:10 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:11 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-24e0edf9-1af0-4db6-8103-e3d6591dfa1f" returned: 0 in 0.738s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Lock "cinder-quobyte-24e0edf9-1af0-4db6-8103-e3d6591dfa1f" released by "delete_volume" :: held 3.612s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:45:11 devstack cinder-volume[85963]: WARNING cinder.quota [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:45:11 devstack cinder-volume[85963]: WARNING cinder.quota [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:45:11 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Created reservations ['9cb8476d-889f-461f-b92b-b9f97459f2d1', '7a5f1d1c-b47b-46d1-a581-4a3f553a6384', '6522b3cd-47fd-45ee-a30e-8400945fa07d', '02122be4-fedc-48ed-aa3b-71d6d25ce2d7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:45:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:45:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:45:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:45:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:45:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:45:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:12 devstack sudo[87796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:45:12 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:12 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.402s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:12 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:45:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Deleted volume successfully. Sep 18 23:45:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa0a21cf-28f5-4332-91b3-f3bd2637c2bd tempest-DeleteServersTestJSON-1257229554 None] Lock "cinder-24e0edf9-1af0-4db6-8103-e3d6591dfa1f-delete_volume" released by "delete_volume" :: held 4.842s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Flow 'volume_create_manager' (a27f97ec-1f65-4a7a-9b9e-2c19f39f020d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312925a3-fb18-4f0c-a00a-172d073adfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312925a3-fb18-4f0c-a00a-172d073adfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1659477322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36575167-2088-4867-89c4-74ad3b83a96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd106245bdfc432cac5c59f745d9db69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:45:20Z,use_quota=True,user_id='d683e5a338a9408f82f3760d62e5cc24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afa97b6-ae65-43c2-a587-f793d15ab92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afa97b6-ae65-43c2-a587-f793d15ab92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df55b5b9-e1d6-417d-bac1-5ccaa5a6adce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df55b5b9-e1d6-417d-bac1-5ccaa5a6adce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36575167-2088-4867-89c4-74ad3b83a96e', 'volume_name': 'volume-36575167-2088-4867-89c4-74ad3b83a96e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb24c6ee-2971-4e5f-a2a4-eb1c3249696d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb24c6ee-2971-4e5f-a2a4-eb1c3249696d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5915bbef-493b-4eae-abf8-a4e9c3ed735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:45:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Volume 36575167-2088-4867-89c4-74ad3b83a96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36575167-2088-4867-89c4-74ad3b83a96e', 'volume_size': 1} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1659477322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36575167-2088-4867-89c4-74ad3b83a96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd106245bdfc432cac5c59f745d9db69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:45:20Z,use_quota=True,user_id='d683e5a338a9408f82f3760d62e5cc24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Creating volume 36575167-2088-4867-89c4-74ad3b83a96e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:45:19 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:45:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-36575167-2088-4867-89c4-74ad3b83a96e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:19 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-36575167-2088-4867-89c4-74ad3b83a96e 1073741824 Sep 18 23:45:19 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:20 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-36575167-2088-4867-89c4-74ad3b83a96e 1073741824" returned: 0 in 0.611s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-36575167-2088-4867-89c4-74ad3b83a96e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:20 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-36575167-2088-4867-89c4-74ad3b83a96e Sep 18 23:45:20 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:20 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-36575167-2088-4867-89c4-74ad3b83a96e" returned: 0 in 0.361s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:45:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:45:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5915bbef-493b-4eae-abf8-a4e9c3ed735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36575167-2088-4867-89c4-74ad3b83a96e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:45:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e35ad6b-d493-46d6-af68-0dce539cc064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:45:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Volume volume-36575167-2088-4867-89c4-74ad3b83a96e (36575167-2088-4867-89c4-74ad3b83a96e): created successfully Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e35ad6b-d493-46d6-af68-0dce539cc064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Flow 'volume_create_manager' (a27f97ec-1f65-4a7a-9b9e-2c19f39f020d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:45:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1a982002-6e6f-4884-9061-081f668fe920 tempest-ServersNegativeTestJSON-762933739 None] Created volume successfully. Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:21 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:45:21 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:21 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.357s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 8 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:45:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Flow 'volume_create_manager' (da38c17e-29aa-4d29-9fcd-6f108628478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64319a55-e043-4e64-b9de-68873304f5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64319a55-e043-4e64-b9de-68873304f5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1707750562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce50ccea-f27e-453a-9b5b-486a267a6d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd106245bdfc432cac5c59f745d9db69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:45:23Z,use_quota=True,user_id='d683e5a338a9408f82f3760d62e5cc24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ba13f0-2cbd-4e08-9f20-15b862dcf41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ba13f0-2cbd-4e08-9f20-15b862dcf41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd55da9-2e68-4501-9a55-0e7dff4fa911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd55da9-2e68-4501-9a55-0e7dff4fa911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce50ccea-f27e-453a-9b5b-486a267a6d65', 'volume_name': 'volume-ce50ccea-f27e-453a-9b5b-486a267a6d65', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73456164-a984-4804-8c13-69985cee8040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73456164-a984-4804-8c13-69985cee8040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926b8420-9e48-4dfd-a07e-13fce340201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:45:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Volume ce50ccea-f27e-453a-9b5b-486a267a6d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce50ccea-f27e-453a-9b5b-486a267a6d65', 'volume_size': 1} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1707750562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce50ccea-f27e-453a-9b5b-486a267a6d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd106245bdfc432cac5c59f745d9db69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:45:23Z,use_quota=True,user_id='d683e5a338a9408f82f3760d62e5cc24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Creating volume ce50ccea-f27e-453a-9b5b-486a267a6d65 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:45:23 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:45:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ce50ccea-f27e-453a-9b5b-486a267a6d65 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:23 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ce50ccea-f27e-453a-9b5b-486a267a6d65 1073741824 Sep 18 23:45:23 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:24 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ce50ccea-f27e-453a-9b5b-486a267a6d65 1073741824" returned: 0 in 0.607s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ce50ccea-f27e-453a-9b5b-486a267a6d65 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:24 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ce50ccea-f27e-453a-9b5b-486a267a6d65 Sep 18 23:45:24 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:24 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ce50ccea-f27e-453a-9b5b-486a267a6d65" returned: 0 in 0.427s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:45:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:45:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926b8420-9e48-4dfd-a07e-13fce340201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce50ccea-f27e-453a-9b5b-486a267a6d65', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:45:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729719dc-f77d-48f8-a02f-5b97cbfc8558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:45:24 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Volume volume-ce50ccea-f27e-453a-9b5b-486a267a6d65 (ce50ccea-f27e-453a-9b5b-486a267a6d65): created successfully Sep 18 23:45:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729719dc-f77d-48f8-a02f-5b97cbfc8558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:45:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Flow 'volume_create_manager' (da38c17e-29aa-4d29-9fcd-6f108628478a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:45:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-94464884-632d-44cc-a6f2-945d77392f43 tempest-ServersNegativeTestJSON-762933739 None] Created volume successfully. Sep 18 23:45:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Acquiring lock "cinder-ce50ccea-f27e-453a-9b5b-486a267a6d65-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:45:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Lock "cinder-ce50ccea-f27e-453a-9b5b-486a267a6d65-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:45:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Acquiring lock "cinder-quobyte-ce50ccea-f27e-453a-9b5b-486a267a6d65" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:45:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Lock "cinder-quobyte-ce50ccea-f27e-453a-9b5b-486a267a6d65" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:45:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[25097e54-cb29-43a5-9909-2d6a7a1144b0]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:45:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ce50ccea-f27e-453a-9b5b-486a267a6d65 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:29 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ce50ccea-f27e-453a-9b5b-486a267a6d65 Sep 18 23:45:29 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:29 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ce50ccea-f27e-453a-9b5b-486a267a6d65" returned: 0 in 0.477s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ce50ccea-f27e-453a-9b5b-486a267a6d65 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:29 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ce50ccea-f27e-453a-9b5b-486a267a6d65 Sep 18 23:45:29 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:29 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ce50ccea-f27e-453a-9b5b-486a267a6d65" returned: 0 in 0.317s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Lock "cinder-quobyte-ce50ccea-f27e-453a-9b5b-486a267a6d65" released by "delete_volume" :: held 0.853s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:45:29 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Created reservations ['0bafb4a2-286c-49b4-bbe9-55739d10f405', 'fa70acec-315c-43d3-be58-e20af519491a', 'c70ee251-0d6c-48f6-ab93-dabe47f2d412', '8616f6bc-cc6a-4c22-a433-20b0541eae5c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:45:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:45:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:45:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:45:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:45:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:45:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:29 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:45:29 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Acquiring lock "cinder-36575167-2088-4867-89c4-74ad3b83a96e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:45:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Lock "cinder-36575167-2088-4867-89c4-74ad3b83a96e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:45:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Acquiring lock "cinder-quobyte-36575167-2088-4867-89c4-74ad3b83a96e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:45:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Lock "cinder-quobyte-36575167-2088-4867-89c4-74ad3b83a96e" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:45:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce91807-75a0-43c9-8c25-bf87366bce68]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:45:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-36575167-2088-4867-89c4-74ad3b83a96e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:30 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.403s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:30 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:45:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Deleted volume successfully. Sep 18 23:45:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45b72ee9-9880-473a-b7db-55de4ac5fc8e tempest-ServersNegativeTestJSON-762933739 None] Lock "cinder-ce50ccea-f27e-453a-9b5b-486a267a6d65-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:45:30 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-36575167-2088-4867-89c4-74ad3b83a96e Sep 18 23:45:30 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:30 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-36575167-2088-4867-89c4-74ad3b83a96e" returned: 0 in 0.481s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-36575167-2088-4867-89c4-74ad3b83a96e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:30 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-36575167-2088-4867-89c4-74ad3b83a96e Sep 18 23:45:30 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:31 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-36575167-2088-4867-89c4-74ad3b83a96e" returned: 0 in 0.288s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Lock "cinder-quobyte-36575167-2088-4867-89c4-74ad3b83a96e" released by "delete_volume" :: held 0.829s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:45:31 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Created reservations ['25ecbd3f-b92f-47ee-b4fe-dee0cd3118c9', 'f04800d9-ca50-4c6a-975c-63eb91bf55d5', '3b4cf484-c74a-4802-9c1a-a36894a7d7b4', '0ed068d8-1c39-43ac-ba64-9be3d5477f5e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:45:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:45:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:45:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:45:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:45:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:45:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:45:31 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:45:31 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:45:31 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Sep 18 23:45:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.294s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:45:31 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:45:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Deleted volume successfully. Sep 18 23:45:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac4be5a0-56e6-4c75-8246-b7175e514d94 tempest-ServersNegativeTestJSON-762933739 None] Lock "cinder-36575167-2088-4867-89c4-74ad3b83a96e-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:45:41 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=30,cinder:UPDATE=36,cinder:DELETE=3,cinder:INSERT=9 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:45:41 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=39,cinder:SELECT=31,cinder:INSERT=7,cinder:DELETE=4 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:45:54 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:45:54 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:46:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-1ea56003-3a5a-4d73-a8b3-8bd3d33e8864 req-815537d4-7106-4ecb-8584-24f7164a466a tempest-TaggedAttachmentsTest-1927507382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:46:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-1ea56003-3a5a-4d73-a8b3-8bd3d33e8864 req-815537d4-7106-4ecb-8584-24f7164a466a tempest-TaggedAttachmentsTest-1927507382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:46:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-1ea56003-3a5a-4d73-a8b3-8bd3d33e8864 req-815537d4-7106-4ecb-8584-24f7164a466a tempest-TaggedAttachmentsTest-1927507382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:46:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-1ea56003-3a5a-4d73-a8b3-8bd3d33e8864 req-815537d4-7106-4ecb-8584-24f7164a466a tempest-TaggedAttachmentsTest-1927507382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb0b127e-ffd5-4100-9225-d72100727b46', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:46:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-1ea56003-3a5a-4d73-a8b3-8bd3d33e8864 req-815537d4-7106-4ecb-8584-24f7164a466a tempest-TaggedAttachmentsTest-1927507382 None] attachment_update completed successfully. Sep 18 23:46:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-08e5b92b-6c79-4843-b0c8-21021c1fc7e9 req-c2a74fe6-6505-49d0-a04b-01047333fe28 tempest-TaggedAttachmentsTest-1927507382 None] Terminate volume connection completed successfully. Sep 18 23:46:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-08e5b92b-6c79-4843-b0c8-21021c1fc7e9 req-c2a74fe6-6505-49d0-a04b-01047333fe28 tempest-TaggedAttachmentsTest-1927507382 None] Deleting attachment eb0b127e-ffd5-4100-9225-d72100727b46. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:46:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:46:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:46:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:46:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:46:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:46:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:46:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:21 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=7 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:46:21 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:46:21 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:46:21 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:21 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.706s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Flow 'volume_create_manager' (72d3d3ac-023f-44dc-8b9f-3d6451293cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ceb651-9e0b-4e93-862d-e57b5f45bd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ceb651-9e0b-4e93-862d-e57b5f45bd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1885792743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910bab79-7044-4c2e-b90a-3a67a597787a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19ff107e4fa4df986f2560f784c9464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:46:24Z,use_quota=True,user_id='d989ba392f5f448d96db85b9a5103529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba84133f-0c6e-4a66-a404-57adb6841aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba84133f-0c6e-4a66-a404-57adb6841aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76422d29-ca08-4f6f-9c34-b19fc9d56dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76422d29-ca08-4f6f-9c34-b19fc9d56dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910bab79-7044-4c2e-b90a-3a67a597787a', 'volume_name': 'volume-910bab79-7044-4c2e-b90a-3a67a597787a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55705bba-98b2-46b6-8c96-b1cfb8055396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55705bba-98b2-46b6-8c96-b1cfb8055396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f13aaaf-1d12-42cc-bf2c-2c490fdb09c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Volume 910bab79-7044-4c2e-b90a-3a67a597787a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910bab79-7044-4c2e-b90a-3a67a597787a', 'volume_size': 1} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1885792743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910bab79-7044-4c2e-b90a-3a67a597787a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c19ff107e4fa4df986f2560f784c9464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:46:24Z,use_quota=True,user_id='d989ba392f5f448d96db85b9a5103529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Creating volume 910bab79-7044-4c2e-b90a-3a67a597787a {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:46:23 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:46:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-910bab79-7044-4c2e-b90a-3a67a597787a 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:23 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-910bab79-7044-4c2e-b90a-3a67a597787a 1073741824 Sep 18 23:46:23 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:24 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-910bab79-7044-4c2e-b90a-3a67a597787a 1073741824" returned: 0 in 0.929s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-910bab79-7044-4c2e-b90a-3a67a597787a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:24 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-910bab79-7044-4c2e-b90a-3a67a597787a Sep 18 23:46:24 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:25 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-910bab79-7044-4c2e-b90a-3a67a597787a" returned: 0 in 0.411s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:46:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:46:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f13aaaf-1d12-42cc-bf2c-2c490fdb09c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910bab79-7044-4c2e-b90a-3a67a597787a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4979cd9d-f47d-4d9d-a4dc-9712d5b6b8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Volume volume-910bab79-7044-4c2e-b90a-3a67a597787a (910bab79-7044-4c2e-b90a-3a67a597787a): created successfully Sep 18 23:46:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4979cd9d-f47d-4d9d-a4dc-9712d5b6b8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Flow 'volume_create_manager' (72d3d3ac-023f-44dc-8b9f-3d6451293cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:46:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7ad1811c-d324-42dc-aa89-7efef7bafe48 tempest-VolumesAdminNegativeTest-1076729074 None] Created volume successfully. Sep 18 23:46:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Acquiring lock "cinder-910bab79-7044-4c2e-b90a-3a67a597787a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:46:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Lock "cinder-910bab79-7044-4c2e-b90a-3a67a597787a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:46:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Acquiring lock "cinder-quobyte-910bab79-7044-4c2e-b90a-3a67a597787a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:46:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Lock "cinder-quobyte-910bab79-7044-4c2e-b90a-3a67a597787a" acquired by "delete_volume" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:46:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3fd40d-2e0c-497a-8621-78f5f035f79b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:46:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-910bab79-7044-4c2e-b90a-3a67a597787a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:26 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-910bab79-7044-4c2e-b90a-3a67a597787a Sep 18 23:46:26 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:26 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-910bab79-7044-4c2e-b90a-3a67a597787a" returned: 0 in 0.532s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-910bab79-7044-4c2e-b90a-3a67a597787a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:26 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-910bab79-7044-4c2e-b90a-3a67a597787a Sep 18 23:46:26 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:27 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-910bab79-7044-4c2e-b90a-3a67a597787a" returned: 0 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Lock "cinder-quobyte-910bab79-7044-4c2e-b90a-3a67a597787a" released by "delete_volume" :: held 0.956s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:46:27 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Created reservations ['c82275ba-6c93-41b6-bf25-6fb9ce934b8e', '2a57a7ca-08bf-42fe-ab94-9c22ddc91a5c', '0ae7b9a7-397f-41c9-add5-0bfc8e209440', 'd713382e-0be9-4f8a-9da7-bcae3715c171'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:46:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:46:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:46:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:46:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:46:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:46:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:27 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:46:27 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:27 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.309s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:27 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:46:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Deleted volume successfully. Sep 18 23:46:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb62636b-3553-40cf-9468-379ef4c42979 tempest-VolumesAdminNegativeTest-1076729074 None] Lock "cinder-910bab79-7044-4c2e-b90a-3a67a597787a-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:46:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Acquiring lock "cinder-b175b213-c5aa-4490-9d8b-ca4cc0f8de16-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:46:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Lock "cinder-b175b213-c5aa-4490-9d8b-ca4cc0f8de16-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:46:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Acquiring lock "cinder-quobyte-b175b213-c5aa-4490-9d8b-ca4cc0f8de16" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:46:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Lock "cinder-quobyte-b175b213-c5aa-4490-9d8b-ca4cc0f8de16" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:46:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f26e9b-b150-41d9-a464-e35f865842c6]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:46:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:30 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16 Sep 18 23:46:30 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:30 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16" returned: 0 in 0.416s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:30 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16 Sep 18 23:46:30 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:30 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b175b213-c5aa-4490-9d8b-ca4cc0f8de16" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Lock "cinder-quobyte-b175b213-c5aa-4490-9d8b-ca4cc0f8de16" released by "delete_volume" :: held 0.779s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:46:31 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Created reservations ['42b9c961-285e-4acd-bfbd-01d8608296e9', '34139f44-5c67-420e-a1d7-31c2a1d361c4', 'd735c8a0-c63b-41a7-a640-d9e9a890b064', '762cbbaf-dc03-40ae-8f69-890cf581fc94'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:46:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:46:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:46:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:46:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:46:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:46:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:31 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:46:31 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:31 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:31 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:46:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Deleted volume successfully. Sep 18 23:46:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-78efd5c9-c8b9-4c91-bbaa-835f3654df17 tempest-TaggedAttachmentsTest-1927507382 None] Lock "cinder-b175b213-c5aa-4490-9d8b-ca4cc0f8de16-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Flow 'volume_create_manager' (861fcf37-6993-4cca-aba9-084133b5e26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230b9b49-b1ee-426e-9e89-024d842e8044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230b9b49-b1ee-426e-9e89-024d842e8044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1231460955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95478a23-2949-4edc-91e3-ee348a17de15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1411a57959e4c6d837dcb57a5c61953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:46:35Z,use_quota=True,user_id='f4eaf4fd02be4dd8b30ec77cdf0df487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b467e52b-cdfa-4ece-a0b7-7d61abe2875f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b467e52b-cdfa-4ece-a0b7-7d61abe2875f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984fff1f-60ca-4d10-bf2a-ca2912fdcf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984fff1f-60ca-4d10-bf2a-ca2912fdcf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95478a23-2949-4edc-91e3-ee348a17de15', 'volume_name': 'volume-95478a23-2949-4edc-91e3-ee348a17de15', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4a5f89-41e7-4d89-a773-11fc4fb2a99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4a5f89-41e7-4d89-a773-11fc4fb2a99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac77b47b-bfda-47b3-9b43-bb4e5541942b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:34 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Volume 95478a23-2949-4edc-91e3-ee348a17de15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95478a23-2949-4edc-91e3-ee348a17de15', 'volume_size': 1} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1231460955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95478a23-2949-4edc-91e3-ee348a17de15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1411a57959e4c6d837dcb57a5c61953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:46:35Z,use_quota=True,user_id='f4eaf4fd02be4dd8b30ec77cdf0df487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Creating volume 95478a23-2949-4edc-91e3-ee348a17de15 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:46:34 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:46:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-95478a23-2949-4edc-91e3-ee348a17de15 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:34 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-95478a23-2949-4edc-91e3-ee348a17de15 1073741824 Sep 18 23:46:34 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:35 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-95478a23-2949-4edc-91e3-ee348a17de15 1073741824" returned: 0 in 0.483s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-95478a23-2949-4edc-91e3-ee348a17de15 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:35 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-95478a23-2949-4edc-91e3-ee348a17de15 Sep 18 23:46:35 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:35 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-95478a23-2949-4edc-91e3-ee348a17de15" returned: 0 in 0.393s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:46:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:46:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac77b47b-bfda-47b3-9b43-bb4e5541942b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95478a23-2949-4edc-91e3-ee348a17de15', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5731fe84-091d-497c-b1f1-632e7a06ef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Volume volume-95478a23-2949-4edc-91e3-ee348a17de15 (95478a23-2949-4edc-91e3-ee348a17de15): created successfully Sep 18 23:46:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5731fe84-091d-497c-b1f1-632e7a06ef16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Flow 'volume_create_manager' (861fcf37-6993-4cca-aba9-084133b5e26b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:46:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4d8e357a-adc8-421a-ac72-5a7ac3829624 tempest-AttachVolumeShelveTestJSON-139720132 None] Created volume successfully. Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Flow 'volume_create_manager' (a52f5661-bc67-4a92-9ef5-780a96ac49d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c59b766-c321-442a-a219-17f573f46abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c59b766-c321-442a-a219-17f573f46abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1707560968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd71d45e-9855-441d-8c13-f8438ff4e754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a00746c912f417bba4d18b6807e2498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:46:44Z,use_quota=True,user_id='d0b01dfe2e774fb8aba3c7f03bb629e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e9169e-5c1d-42a3-9d48-5f10001af88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e9169e-5c1d-42a3-9d48-5f10001af88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ed84d0-fce7-446c-8b15-73989e15f60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ed84d0-fce7-446c-8b15-73989e15f60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd71d45e-9855-441d-8c13-f8438ff4e754', 'volume_name': 'volume-cd71d45e-9855-441d-8c13-f8438ff4e754', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34795108-34fa-4f64-9782-65a80634baaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34795108-34fa-4f64-9782-65a80634baaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3727bdb2-222f-4cea-a95d-0566c240c8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:44 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Volume cd71d45e-9855-441d-8c13-f8438ff4e754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd71d45e-9855-441d-8c13-f8438ff4e754', 'volume_size': 1} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1707560968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd71d45e-9855-441d-8c13-f8438ff4e754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a00746c912f417bba4d18b6807e2498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:46:44Z,use_quota=True,user_id='d0b01dfe2e774fb8aba3c7f03bb629e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Creating volume cd71d45e-9855-441d-8c13-f8438ff4e754 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:46:44 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cd71d45e-9855-441d-8c13-f8438ff4e754 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:44 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cd71d45e-9855-441d-8c13-f8438ff4e754 1073741824 Sep 18 23:46:44 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:44 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cd71d45e-9855-441d-8c13-f8438ff4e754 1073741824" returned: 0 in 0.527s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cd71d45e-9855-441d-8c13-f8438ff4e754 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:46:44 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cd71d45e-9855-441d-8c13-f8438ff4e754 Sep 18 23:46:44 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:46:45 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Sep 18 23:46:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cd71d45e-9855-441d-8c13-f8438ff4e754" returned: 0 in 0.302s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:46:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:46:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:46:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3727bdb2-222f-4cea-a95d-0566c240c8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd71d45e-9855-441d-8c13-f8438ff4e754', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdc7a25-5fd3-4155-85a6-838290a37316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:46:45 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Volume volume-cd71d45e-9855-441d-8c13-f8438ff4e754 (cd71d45e-9855-441d-8c13-f8438ff4e754): created successfully Sep 18 23:46:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdc7a25-5fd3-4155-85a6-838290a37316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:46:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Flow 'volume_create_manager' (a52f5661-bc67-4a92-9ef5-780a96ac49d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:46:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fc3cf5e8-ee34-42e1-9b86-b4e6b5552d11 tempest-AttachVolumeNegativeTest-931395348 None] Created volume successfully. Sep 18 23:46:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-ed910ef8-8cc8-4a9e-88dc-ed63c359fe37 req-4385756a-716a-47bc-9ef7-5484224d85e9 tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:46:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-ed910ef8-8cc8-4a9e-88dc-ed63c359fe37 req-4385756a-716a-47bc-9ef7-5484224d85e9 tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:46:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-ed910ef8-8cc8-4a9e-88dc-ed63c359fe37 req-4385756a-716a-47bc-9ef7-5484224d85e9 tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:46:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-ed910ef8-8cc8-4a9e-88dc-ed63c359fe37 req-4385756a-716a-47bc-9ef7-5484224d85e9 tempest-AttachVolumeNegativeTest-931395348 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-cd71d45e-9855-441d-8c13-f8438ff4e754', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6adba689-adca-4509-b3a1-660c102cf6e1', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:46:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-ed910ef8-8cc8-4a9e-88dc-ed63c359fe37 req-4385756a-716a-47bc-9ef7-5484224d85e9 tempest-AttachVolumeNegativeTest-931395348 None] attachment_update completed successfully. Sep 18 23:46:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-fd0226d0-8853-4660-87c5-e07343d1d36f req-333e18ce-6148-4ef8-9dcf-18fdcba207cb tempest-AttachVolumeShelveTestJSON-139720132 None] No connector for attachment e246a920-aecd-40cf-82dc-2396e7dd5cf1; skipping storage backend terminate_connection call. {{(pid=85963) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 18 23:46:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-fd0226d0-8853-4660-87c5-e07343d1d36f req-333e18ce-6148-4ef8-9dcf-18fdcba207cb tempest-AttachVolumeShelveTestJSON-139720132 None] Deleting attachment e246a920-aecd-40cf-82dc-2396e7dd5cf1. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:46:59 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=28,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=2 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:46:59 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=19,cinder:UPDATE=30,cinder:INSERT=4,cinder:DELETE=3 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:47:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:47:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:47:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:47:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:47:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:47:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:47:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:47:21 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:47:21 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:47:22 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Sep 18 23:47:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 1.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:47:22 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:47:22 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:47:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 8 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:47:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:47:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-f7133496-b802-479f-9d43-b1e4544a8123 req-33b83673-c150-4779-b45a-d4fae9aeb84f tempest-AttachVolumeNegativeTest-931395348 None] Terminate volume connection completed successfully. Sep 18 23:47:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-f7133496-b802-479f-9d43-b1e4544a8123 req-33b83673-c150-4779-b45a-d4fae9aeb84f tempest-AttachVolumeNegativeTest-931395348 None] Deleting attachment 6adba689-adca-4509-b3a1-660c102cf6e1. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Flow 'volume_create_manager' (98370ac1-6a4b-4bd3-bfdd-ca762156f252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be60b009-eda3-4349-a4af-9756e68ec392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be60b009-eda3-4349-a4af-9756e68ec392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1347803027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6367d5-6d27-4d4d-a260-c87ea3a1b052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130ea1a623474c5a939a930a1fb1f00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:47:47Z,use_quota=True,user_id='f0e9c0edb084408b8dcec222d908f1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cec2dd0-d6c7-40b3-bc5d-a89959d81e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cec2dd0-d6c7-40b3-bc5d-a89959d81e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf886b7-0c6f-41d9-b403-19e1a9cf7c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf886b7-0c6f-41d9-b403-19e1a9cf7c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6367d5-6d27-4d4d-a260-c87ea3a1b052', 'volume_name': 'volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac11479f-10d6-49b4-8489-8dcb806ce7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac11479f-10d6-49b4-8489-8dcb806ce7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e73f4b-4b83-4556-bda4-dc5d03a893f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:47:47 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Volume fa6367d5-6d27-4d4d-a260-c87ea3a1b052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052', 'volume_size': 1} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1347803027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6367d5-6d27-4d4d-a260-c87ea3a1b052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130ea1a623474c5a939a930a1fb1f00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:47:47Z,use_quota=True,user_id='f0e9c0edb084408b8dcec222d908f1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Creating volume fa6367d5-6d27-4d4d-a260-c87ea3a1b052 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:47:47 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:47:47 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052 1073741824 Sep 18 23:47:47 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:47:47 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052 1073741824" returned: 0 in 0.689s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:47:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:47:47 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052 Sep 18 23:47:47 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:47:48 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Sep 18 23:47:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052" returned: 0 in 0.807s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:47:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:47:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:47:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e73f4b-4b83-4556-bda4-dc5d03a893f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:47:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb70b8e5-dfb4-43c2-a66d-3e0f3f23b610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:47:48 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Volume volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052 (fa6367d5-6d27-4d4d-a260-c87ea3a1b052): created successfully Sep 18 23:47:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb70b8e5-dfb4-43c2-a66d-3e0f3f23b610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:47:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Flow 'volume_create_manager' (98370ac1-6a4b-4bd3-bfdd-ca762156f252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:47:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fe200fd2-60a0-448c-b1c2-08a1627fae4a tempest-ServerRescueNegativeTestJSON-1063870522 None] Created volume successfully. Sep 18 23:47:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Acquiring lock "cinder-95478a23-2949-4edc-91e3-ee348a17de15-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:47:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Lock "cinder-95478a23-2949-4edc-91e3-ee348a17de15-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:47:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Acquiring lock "cinder-quobyte-95478a23-2949-4edc-91e3-ee348a17de15" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:47:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Lock "cinder-quobyte-95478a23-2949-4edc-91e3-ee348a17de15" acquired by "delete_volume" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:47:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f90053e-8882-4f6d-a31e-6c18aef31a7e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:47:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-95478a23-2949-4edc-91e3-ee348a17de15 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:47:50 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-95478a23-2949-4edc-91e3-ee348a17de15 Sep 18 23:47:50 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:47:51 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Sep 18 23:47:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-95478a23-2949-4edc-91e3-ee348a17de15" returned: 0 in 0.712s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:47:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-95478a23-2949-4edc-91e3-ee348a17de15 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:47:51 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-95478a23-2949-4edc-91e3-ee348a17de15 Sep 18 23:47:51 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:47:51 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Sep 18 23:47:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-95478a23-2949-4edc-91e3-ee348a17de15" returned: 0 in 0.395s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:47:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Lock "cinder-quobyte-95478a23-2949-4edc-91e3-ee348a17de15" released by "delete_volume" :: held 1.212s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:47:51 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Created reservations ['4d87bf87-1ae2-4eaf-a430-a119ae703eaf', '2c236276-e22f-44ec-857a-a50bc2bbd6d0', 'a823fac8-e375-44bc-8513-fb5cc6406f4a', '1badb7af-3e9c-43dc-8f73-b2d9b965c81e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:47:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:47:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:47:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:47:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:47:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:47:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:47:51 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:47:52 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:47:52 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Sep 18 23:47:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.489s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:47:52 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:47:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Deleted volume successfully. Sep 18 23:47:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-725cc7ca-4179-4bc5-a531-312363a7b34c tempest-AttachVolumeShelveTestJSON-139720132 None] Lock "cinder-95478a23-2949-4edc-91e3-ee348a17de15-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:48:01 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=10,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:48:02 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:48:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Acquiring lock "cinder-fa6367d5-6d27-4d4d-a260-c87ea3a1b052-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:48:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Lock "cinder-fa6367d5-6d27-4d4d-a260-c87ea3a1b052-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:48:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Acquiring lock "cinder-quobyte-fa6367d5-6d27-4d4d-a260-c87ea3a1b052" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:48:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Lock "cinder-quobyte-fa6367d5-6d27-4d4d-a260-c87ea3a1b052" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:48:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5de6768-7d84-40d9-9936-35f6a94fae3b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:48:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:48:04 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052 Sep 18 23:48:04 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:48:04 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Sep 18 23:48:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052" returned: 0 in 0.566s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:48:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:48:04 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052 Sep 18 23:48:04 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:48:04 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Sep 18 23:48:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6367d5-6d27-4d4d-a260-c87ea3a1b052" returned: 0 in 0.389s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:48:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Lock "cinder-quobyte-fa6367d5-6d27-4d4d-a260-c87ea3a1b052" released by "delete_volume" :: held 1.012s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:48:05 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Created reservations ['ff7167a5-a7eb-48d0-a2d1-199285c2e782', '73d4ee94-388e-49ad-b54d-535e2b88790b', '09222eb5-c61d-4e13-959c-61622180bd46', '4fd3d568-619d-4502-b8d7-06ec1d35d379'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:48:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:48:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:48:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:48:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:48:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:48:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:48:05 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:48:05 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:48:05 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Sep 18 23:48:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.374s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:48:05 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:48:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Deleted volume successfully. Sep 18 23:48:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-faf8e58b-ffb8-468c-9bc2-18569d01ed87 tempest-ServerRescueNegativeTestJSON-1063870522 None] Lock "cinder-fa6367d5-6d27-4d4d-a260-c87ea3a1b052-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Flow 'volume_create_manager' (f4e4e83a-0a3a-4529-912e-1c7bddfbb277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b078a0-ca3e-4763-8f53-014146bf928a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b078a0-ca3e-4763-8f53-014146bf928a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2013886820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a35bc2-c1c4-40ea-af4e-950e82a3f6fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a909b28d28d4231bfc2327005575b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:48:13Z,use_quota=True,user_id='d53dd4811360410392ce45a2c3038583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0fef7b-3b93-47d9-ab16-75fbd39b9b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0fef7b-3b93-47d9-ab16-75fbd39b9b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ec652c-fd62-4771-bb7c-6c21b0f81b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ec652c-fd62-4771-bb7c-6c21b0f81b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a35bc2-c1c4-40ea-af4e-950e82a3f6fd', 'volume_name': 'volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8853c6-97ee-46f0-b5da-3fc5c3c8cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8853c6-97ee-46f0-b5da-3fc5c3c8cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e876117-0e57-4c83-9000-231ee1635a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:48:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Volume 39a35bc2-c1c4-40ea-af4e-950e82a3f6fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd', 'volume_size': 1} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2013886820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a35bc2-c1c4-40ea-af4e-950e82a3f6fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a909b28d28d4231bfc2327005575b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:48:13Z,use_quota=True,user_id='d53dd4811360410392ce45a2c3038583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Creating volume 39a35bc2-c1c4-40ea-af4e-950e82a3f6fd {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:48:12 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:48:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:48:12 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd 1073741824 Sep 18 23:48:12 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:48:14 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Sep 18 23:48:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd 1073741824" returned: 0 in 1.169s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:48:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:48:14 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd Sep 18 23:48:14 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:48:14 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Sep 18 23:48:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd" returned: 0 in 0.376s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:48:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:48:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:48:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e876117-0e57-4c83-9000-231ee1635a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:48:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35257539-9eeb-4508-9150-d58007c0befc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:48:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Volume volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd (39a35bc2-c1c4-40ea-af4e-950e82a3f6fd): created successfully Sep 18 23:48:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35257539-9eeb-4508-9150-d58007c0befc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:48:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Flow 'volume_create_manager' (f4e4e83a-0a3a-4529-912e-1c7bddfbb277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:48:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7588a70b-8250-41d3-97da-b3ee489f0ef7 tempest-ServerActionsTestOtherA-2129144877 None] Created volume successfully. Sep 18 23:48:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:48:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:48:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:48:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:48:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:48:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:48:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:48:21 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:48:21 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:48:21 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Sep 18 23:48:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.547s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:48:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:48:24 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:48:24 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Flow 'volume_create_manager' (9224f6fe-4216-4304-9a5b-1658766459b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8825299d-be76-4e99-8da6-b951992066ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8825299d-be76-4e99-8da6-b951992066ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1496258196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a00746c912f417bba4d18b6807e2498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:48:37Z,use_quota=True,user_id='d0b01dfe2e774fb8aba3c7f03bb629e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7757d727-80ef-4eba-9b18-0186dd9eb97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7757d727-80ef-4eba-9b18-0186dd9eb97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ed725e-bd96-4720-8034-7a26f0739dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ed725e-bd96-4720-8034-7a26f0739dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0', 'volume_name': 'volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49f8ead-875b-4343-a528-58ef616e8231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49f8ead-875b-4343-a528-58ef616e8231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298fb531-798c-4e52-8e23-59c602867ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:48:37 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Volume e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0', 'volume_size': 1} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1496258196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a00746c912f417bba4d18b6807e2498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:48:37Z,use_quota=True,user_id='d0b01dfe2e774fb8aba3c7f03bb629e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Creating volume e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:48:37 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:48:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:48:37 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0 1073741824 Sep 18 23:48:37 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:48:38 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Sep 18 23:48:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0 1073741824" returned: 0 in 0.827s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:48:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:48:38 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0 Sep 18 23:48:38 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:48:38 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Sep 18 23:48:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0" returned: 0 in 0.317s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:48:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:48:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:48:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298fb531-798c-4e52-8e23-59c602867ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:48:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11068e5-b44f-4f1c-aeb8-36cb74c1efe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:48:38 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Volume volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0 (e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0): created successfully Sep 18 23:48:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11068e5-b44f-4f1c-aeb8-36cb74c1efe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:48:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Flow 'volume_create_manager' (9224f6fe-4216-4304-9a5b-1658766459b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:48:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a137810e-ce16-416e-af32-d70525f849ec tempest-AttachVolumeNegativeTest-931395348 None] Created volume successfully. Sep 18 23:48:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-1a9e531a-619e-41f9-9d66-f24d10194109 req-d4b5f426-57ac-44b5-a0ef-f72679e73a20 tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:48:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-1a9e531a-619e-41f9-9d66-f24d10194109 req-d4b5f426-57ac-44b5-a0ef-f72679e73a20 tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:48:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-1a9e531a-619e-41f9-9d66-f24d10194109 req-d4b5f426-57ac-44b5-a0ef-f72679e73a20 tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:48:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-1a9e531a-619e-41f9-9d66-f24d10194109 req-d4b5f426-57ac-44b5-a0ef-f72679e73a20 tempest-AttachVolumeNegativeTest-931395348 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b5158ad-0e9c-4bb2-a266-7b351af21050', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:48:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-1a9e531a-619e-41f9-9d66-f24d10194109 req-d4b5f426-57ac-44b5-a0ef-f72679e73a20 tempest-AttachVolumeNegativeTest-931395348 None] attachment_update completed successfully. Sep 18 23:48:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-621f59dc-cba7-4259-9580-25e6254eeca8 req-4cdb0487-f627-4483-949f-3b11ead57fc1 tempest-AttachVolumeNegativeTest-931395348 None] Terminate volume connection completed successfully. Sep 18 23:48:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-621f59dc-cba7-4259-9580-25e6254eeca8 req-4cdb0487-f627-4483-949f-3b11ead57fc1 tempest-AttachVolumeNegativeTest-931395348 None] Deleting attachment 0b5158ad-0e9c-4bb2-a266-7b351af21050. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:48:50 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:48:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-6fa1a11e-1c16-44bf-9bfd-81642a795a72 req-a652c9a1-60ad-4e98-8d27-a82a22a02bdd tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:48:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-6fa1a11e-1c16-44bf-9bfd-81642a795a72 req-a652c9a1-60ad-4e98-8d27-a82a22a02bdd tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:48:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-6fa1a11e-1c16-44bf-9bfd-81642a795a72 req-a652c9a1-60ad-4e98-8d27-a82a22a02bdd tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:48:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-6fa1a11e-1c16-44bf-9bfd-81642a795a72 req-a652c9a1-60ad-4e98-8d27-a82a22a02bdd tempest-ServerActionsTestOtherA-2129144877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6812330c-89b6-4a95-b673-a7968c9f2cde', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:48:54 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-6fa1a11e-1c16-44bf-9bfd-81642a795a72 req-a652c9a1-60ad-4e98-8d27-a82a22a02bdd tempest-ServerActionsTestOtherA-2129144877 None] attachment_update completed successfully. Sep 18 23:48:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-93795f65-7b46-466a-aaf2-95dc0ccc0867 req-00c7aaea-92ba-4cc7-a152-2b6d673df718 tempest-ServerActionsTestOtherA-2129144877 None] Terminate volume connection completed successfully. Sep 18 23:48:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-93795f65-7b46-466a-aaf2-95dc0ccc0867 req-00c7aaea-92ba-4cc7-a152-2b6d673df718 tempest-ServerActionsTestOtherA-2129144877 None] Deleting attachment 6812330c-89b6-4a95-b673-a7968c9f2cde. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:49:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-93795f65-7b46-466a-aaf2-95dc0ccc0867 req-13785e14-52fb-4d03-83d5-4c0eef3f63e0 tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-93795f65-7b46-466a-aaf2-95dc0ccc0867 req-13785e14-52fb-4d03-83d5-4c0eef3f63e0 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-93795f65-7b46-466a-aaf2-95dc0ccc0867 req-13785e14-52fb-4d03-83d5-4c0eef3f63e0 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-93795f65-7b46-466a-aaf2-95dc0ccc0867 req-13785e14-52fb-4d03-83d5-4c0eef3f63e0 tempest-ServerActionsTestOtherA-2129144877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '211be340-2ccf-4c76-bc3a-e0204803fc27', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:49:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-93795f65-7b46-466a-aaf2-95dc0ccc0867 req-13785e14-52fb-4d03-83d5-4c0eef3f63e0 tempest-ServerActionsTestOtherA-2129144877 None] attachment_update completed successfully. Sep 18 23:49:01 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Flow 'volume_create_manager' (53e509b9-f681-4f98-abaa-0451c0186d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b779d92d-7a58-4bcc-a615-4631fd3790fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b779d92d-7a58-4bcc-a615-4631fd3790fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1720136698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064efdb6-2231-4f73-9014-f7ecd5a11dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d35b3f6ab3e4a899342afd04de98d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:02Z,use_quota=True,user_id='f25185a157894bd7a34521fe0d952f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6354489c-2e5d-4dd0-9af6-18629d97d73e),volume_type_id=6354489c-2e5d-4dd0-9af6-18629d97d73e)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5423cde9-c73f-4373-981f-1684b713e293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5423cde9-c73f-4373-981f-1684b713e293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76628e36-18a9-4afe-8d58-2fae601ac05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76628e36-18a9-4afe-8d58-2fae601ac05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064efdb6-2231-4f73-9014-f7ecd5a11dde', 'volume_name': 'volume-064efdb6-2231-4f73-9014-f7ecd5a11dde', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd036701-2870-4e85-9e96-be53cf651c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd036701-2870-4e85-9e96-be53cf651c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cff0684-e114-43b9-9406-d742d6a7d164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Volume 064efdb6-2231-4f73-9014-f7ecd5a11dde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064efdb6-2231-4f73-9014-f7ecd5a11dde', 'volume_size': 1} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1720136698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064efdb6-2231-4f73-9014-f7ecd5a11dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d35b3f6ab3e4a899342afd04de98d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:02Z,use_quota=True,user_id='f25185a157894bd7a34521fe0d952f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6354489c-2e5d-4dd0-9af6-18629d97d73e),volume_type_id=6354489c-2e5d-4dd0-9af6-18629d97d73e)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Creating volume 064efdb6-2231-4f73-9014-f7ecd5a11dde {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:49:02 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-064efdb6-2231-4f73-9014-f7ecd5a11dde 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:02 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-064efdb6-2231-4f73-9014-f7ecd5a11dde 1073741824 Sep 18 23:49:02 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Flow 'volume_create_manager' (9bffea6f-ba8d-403c-9b3e-1593e5c3d589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba41961-9488-4b23-895b-4cb79df076db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ba41961-9488-4b23-895b-4cb79df076db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2053589847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b94bfa2-6184-4b70-a09e-fec3480e0bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd497021e35403b8c419e014a418c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:03Z,use_quota=True,user_id='9479ce5868cb402697d9b72545a0fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5381df77-ce83-4d01-88b3-c888beeb3107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5381df77-ce83-4d01-88b3-c888beeb3107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd843156-b78c-40af-91b1-d37af3f49485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd843156-b78c-40af-91b1-d37af3f49485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b94bfa2-6184-4b70-a09e-fec3480e0bef', 'volume_name': 'volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6b3d0f-f42f-40b8-8126-ea84cc040944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6b3d0f-f42f-40b8-8126-ea84cc040944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ac2f44-04a7-446f-829c-56fe2e0c5f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Volume 6b94bfa2-6184-4b70-a09e-fec3480e0bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef', 'volume_size': 1} Sep 18 23:49:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:03 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-064efdb6-2231-4f73-9014-f7ecd5a11dde 1073741824" returned: 0 in 1.306s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-064efdb6-2231-4f73-9014-f7ecd5a11dde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:03 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-064efdb6-2231-4f73-9014-f7ecd5a11dde Sep 18 23:49:03 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:04 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-064efdb6-2231-4f73-9014-f7ecd5a11dde" returned: 0 in 0.565s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2053589847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b94bfa2-6184-4b70-a09e-fec3480e0bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd497021e35403b8c419e014a418c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:03Z,use_quota=True,user_id='9479ce5868cb402697d9b72545a0fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Creating volume 6b94bfa2-6184-4b70-a09e-fec3480e0bef {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:49:04 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cff0684-e114-43b9-9406-d742d6a7d164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064efdb6-2231-4f73-9014-f7ecd5a11dde', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:04 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef 1073741824 Sep 18 23:49:04 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f8cf33-31c9-4269-95e3-cbffef0cad9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:04 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Volume volume-064efdb6-2231-4f73-9014-f7ecd5a11dde (064efdb6-2231-4f73-9014-f7ecd5a11dde): created successfully Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f8cf33-31c9-4269-95e3-cbffef0cad9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Flow 'volume_create_manager' (53e509b9-f681-4f98-abaa-0451c0186d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-bb7b6e98-7afe-4bc7-964d-2bc268c5fa34 tempest-VolumeTypesAccessTest-1494291868 None] Created volume successfully. Sep 18 23:49:05 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef 1073741824" returned: 0 in 0.724s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:05 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef Sep 18 23:49:05 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Acquiring lock "cinder-064efdb6-2231-4f73-9014-f7ecd5a11dde-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Lock "cinder-064efdb6-2231-4f73-9014-f7ecd5a11dde-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Acquiring lock "cinder-quobyte-064efdb6-2231-4f73-9014-f7ecd5a11dde" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Lock "cinder-quobyte-064efdb6-2231-4f73-9014-f7ecd5a11dde" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a63e12e-2c13-4c2a-89e8-7dd71d1f8a7a]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-064efdb6-2231-4f73-9014-f7ecd5a11dde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:05 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef" returned: 0 in 0.521s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ac2f44-04a7-446f-829c-56fe2e0c5f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199a046f-1783-4aa9-84e7-cf59c2cea183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Volume volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef (6b94bfa2-6184-4b70-a09e-fec3480e0bef): created successfully Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199a046f-1783-4aa9-84e7-cf59c2cea183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Flow 'volume_create_manager' (9bffea6f-ba8d-403c-9b3e-1593e5c3d589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8763e5e2-a328-48b6-ba9a-7bdd66efe58b tempest-AttachVolumeTestJSON-268412481 None] Created volume successfully. Sep 18 23:49:05 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-064efdb6-2231-4f73-9014-f7ecd5a11dde Sep 18 23:49:05 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:06 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-064efdb6-2231-4f73-9014-f7ecd5a11dde" returned: 0 in 0.812s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-064efdb6-2231-4f73-9014-f7ecd5a11dde {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:06 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-064efdb6-2231-4f73-9014-f7ecd5a11dde Sep 18 23:49:06 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:06 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-064efdb6-2231-4f73-9014-f7ecd5a11dde" returned: 0 in 0.582s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Lock "cinder-quobyte-064efdb6-2231-4f73-9014-f7ecd5a11dde" released by "delete_volume" :: held 1.495s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:07 devstack cinder-volume[85963]: WARNING cinder.quota [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1412620095 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1412620095, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:49:07 devstack cinder-volume[85963]: WARNING cinder.quota [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1412620095 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1412620095, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Created reservations ['5e1c611b-5e1a-4a2c-a798-0d2d9a8b593f', 'c583fd78-f59d-4796-9e74-06fa2ccc071f', '665bae98-e204-4fde-8fd5-5407c4da5fcd', 'e17f3797-6293-4f95-88b6-ef101625b6bf'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:07 devstack sudo[92457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:49:07 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-e602b2ab-b674-4c3e-b446-9d1b1fdfae1e req-065171fe-1df7-4259-91b0-64b8f22574b5 tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-e602b2ab-b674-4c3e-b446-9d1b1fdfae1e req-065171fe-1df7-4259-91b0-64b8f22574b5 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-e602b2ab-b674-4c3e-b446-9d1b1fdfae1e req-065171fe-1df7-4259-91b0-64b8f22574b5 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-e602b2ab-b674-4c3e-b446-9d1b1fdfae1e req-065171fe-1df7-4259-91b0-64b8f22574b5 tempest-AttachVolumeTestJSON-268412481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '322e2125-d1b2-4dee-a3c6-52a47efca59e', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:49:07 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.537s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:07 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:49:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Deleted volume successfully. Sep 18 23:49:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-e602b2ab-b674-4c3e-b446-9d1b1fdfae1e req-065171fe-1df7-4259-91b0-64b8f22574b5 tempest-AttachVolumeTestJSON-268412481 None] attachment_update completed successfully. Sep 18 23:49:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-088da653-8cc3-47c2-bdd2-875e795b6307 tempest-VolumeTypesAccessTest-1494291868 None] Lock "cinder-064efdb6-2231-4f73-9014-f7ecd5a11dde-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:17 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=26,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=2 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:49:17 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=27,cinder:SELECT=44,cinder:DELETE=1,cinder:INSERT=3 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Flow 'volume_create_manager' (3844d864-2425-4e30-8349-bbd9cebad85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4406a8ed-eb87-4efc-b2cd-deacf14eeac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4406a8ed-eb87-4efc-b2cd-deacf14eeac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-537761052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194bc81d-3045-4330-8d4e-c52be2d3f30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98590adfc68455bbd27c0a62b9df15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:21Z,use_quota=True,user_id='98e9e602ccb64805aeb73e23f40ed370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9601faa-d5a9-43c6-ac48-fd259cba9f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9601faa-d5a9-43c6-ac48-fd259cba9f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e36070d-a6f3-4e7c-b38c-b239a2566e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e36070d-a6f3-4e7c-b38c-b239a2566e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194bc81d-3045-4330-8d4e-c52be2d3f30f', 'volume_name': 'volume-194bc81d-3045-4330-8d4e-c52be2d3f30f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6b08e9-32af-452d-b083-32134106c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6b08e9-32af-452d-b083-32134106c13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d102505d-123b-420f-8b93-32009a337c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Volume 194bc81d-3045-4330-8d4e-c52be2d3f30f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194bc81d-3045-4330-8d4e-c52be2d3f30f', 'volume_size': 1} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-537761052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194bc81d-3045-4330-8d4e-c52be2d3f30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98590adfc68455bbd27c0a62b9df15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:21Z,use_quota=True,user_id='98e9e602ccb64805aeb73e23f40ed370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Creating volume 194bc81d-3045-4330-8d4e-c52be2d3f30f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:49:20 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:49:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-194bc81d-3045-4330-8d4e-c52be2d3f30f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:20 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-194bc81d-3045-4330-8d4e-c52be2d3f30f 1073741824 Sep 18 23:49:20 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:21 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:49:21 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:21 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-194bc81d-3045-4330-8d4e-c52be2d3f30f 1073741824" returned: 0 in 0.578s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:21 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 8 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-194bc81d-3045-4330-8d4e-c52be2d3f30f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:21 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-194bc81d-3045-4330-8d4e-c52be2d3f30f Sep 18 23:49:21 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:21 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-194bc81d-3045-4330-8d4e-c52be2d3f30f" returned: 0 in 0.279s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d102505d-123b-420f-8b93-32009a337c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194bc81d-3045-4330-8d4e-c52be2d3f30f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc87f3b-14bb-456f-a2a2-205a92bf7cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Volume volume-194bc81d-3045-4330-8d4e-c52be2d3f30f (194bc81d-3045-4330-8d4e-c52be2d3f30f): created successfully Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc87f3b-14bb-456f-a2a2-205a92bf7cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Flow 'volume_create_manager' (3844d864-2425-4e30-8349-bbd9cebad85a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-bed57356-448f-420e-ad3b-938b2172c8e7 tempest-VolumesListAdminTestJSON-1045214710 None] Created volume successfully. Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Flow 'volume_create_manager' (c581441c-9f3c-4d31-9cd1-da9ffb3ecc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48a77497-05f1-4460-981a-32ba409505dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48a77497-05f1-4460-981a-32ba409505dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-163023319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f735ba-f694-4c79-ad4f-50edb8f3d135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98590adfc68455bbd27c0a62b9df15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:23Z,use_quota=True,user_id='98e9e602ccb64805aeb73e23f40ed370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d834da36-c0ae-4716-bc55-957780d8f8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d834da36-c0ae-4716-bc55-957780d8f8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e59ce2-0791-4809-9e24-7ff1fea6e951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e59ce2-0791-4809-9e24-7ff1fea6e951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f735ba-f694-4c79-ad4f-50edb8f3d135', 'volume_name': 'volume-82f735ba-f694-4c79-ad4f-50edb8f3d135', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2980e17f-688a-4bd4-843b-2a16f79d093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2980e17f-688a-4bd4-843b-2a16f79d093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34489e87-cc0c-4bb5-bf1e-6e3ad0a26c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Volume 82f735ba-f694-4c79-ad4f-50edb8f3d135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f735ba-f694-4c79-ad4f-50edb8f3d135', 'volume_size': 1} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-163023319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f735ba-f694-4c79-ad4f-50edb8f3d135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98590adfc68455bbd27c0a62b9df15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:23Z,use_quota=True,user_id='98e9e602ccb64805aeb73e23f40ed370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Creating volume 82f735ba-f694-4c79-ad4f-50edb8f3d135 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:49:23 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-82f735ba-f694-4c79-ad4f-50edb8f3d135 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:23 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-82f735ba-f694-4c79-ad4f-50edb8f3d135 1073741824 Sep 18 23:49:23 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:23 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-82f735ba-f694-4c79-ad4f-50edb8f3d135 1073741824" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-82f735ba-f694-4c79-ad4f-50edb8f3d135 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:23 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-82f735ba-f694-4c79-ad4f-50edb8f3d135 Sep 18 23:49:23 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:24 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-82f735ba-f694-4c79-ad4f-50edb8f3d135" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:49:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34489e87-cc0c-4bb5-bf1e-6e3ad0a26c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f735ba-f694-4c79-ad4f-50edb8f3d135', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8824570a-0328-4589-9705-ca08263dbb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:24 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Volume volume-82f735ba-f694-4c79-ad4f-50edb8f3d135 (82f735ba-f694-4c79-ad4f-50edb8f3d135): created successfully Sep 18 23:49:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8824570a-0328-4589-9705-ca08263dbb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Flow 'volume_create_manager' (c581441c-9f3c-4d31-9cd1-da9ffb3ecc23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2ff0289b-ccc4-4032-9613-76c434c636ba tempest-VolumesListAdminTestJSON-1045214710 None] Created volume successfully. Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Flow 'volume_create_manager' (f2abcb3f-0234-4b09-8c49-6bc41997df5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a005bcbe-6df3-4e48-b455-9ea1364bc3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a005bcbe-6df3-4e48-b455-9ea1364bc3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-517544312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db06524-e3f4-46ff-97eb-8115f87c7d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98590adfc68455bbd27c0a62b9df15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:25Z,use_quota=True,user_id='98e9e602ccb64805aeb73e23f40ed370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a5844f-f75a-4d32-a2d3-71a23576c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a5844f-f75a-4d32-a2d3-71a23576c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae94a66-4820-4a9e-8ea2-02d94716460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae94a66-4820-4a9e-8ea2-02d94716460e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db06524-e3f4-46ff-97eb-8115f87c7d01', 'volume_name': 'volume-5db06524-e3f4-46ff-97eb-8115f87c7d01', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7499bf09-0134-4bfa-b642-2f9550f2b9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7499bf09-0134-4bfa-b642-2f9550f2b9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7415b2-92c7-47d6-bdf0-d976d6881869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Volume 5db06524-e3f4-46ff-97eb-8115f87c7d01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db06524-e3f4-46ff-97eb-8115f87c7d01', 'volume_size': 1} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-517544312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db06524-e3f4-46ff-97eb-8115f87c7d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98590adfc68455bbd27c0a62b9df15a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:25Z,use_quota=True,user_id='98e9e602ccb64805aeb73e23f40ed370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Creating volume 5db06524-e3f4-46ff-97eb-8115f87c7d01 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:49:25 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5db06524-e3f4-46ff-97eb-8115f87c7d01 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:25 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5db06524-e3f4-46ff-97eb-8115f87c7d01 1073741824 Sep 18 23:49:25 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:25 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5db06524-e3f4-46ff-97eb-8115f87c7d01 1073741824" returned: 0 in 0.442s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5db06524-e3f4-46ff-97eb-8115f87c7d01 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:25 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5db06524-e3f4-46ff-97eb-8115f87c7d01 Sep 18 23:49:25 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:25 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5db06524-e3f4-46ff-97eb-8115f87c7d01" returned: 0 in 0.262s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7415b2-92c7-47d6-bdf0-d976d6881869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db06524-e3f4-46ff-97eb-8115f87c7d01', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e303f410-4686-4906-85d1-78b8aab83c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Volume volume-5db06524-e3f4-46ff-97eb-8115f87c7d01 (5db06524-e3f4-46ff-97eb-8115f87c7d01): created successfully Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e303f410-4686-4906-85d1-78b8aab83c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Flow 'volume_create_manager' (f2abcb3f-0234-4b09-8c49-6bc41997df5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9894d69f-07b7-4d0b-b18a-c23c84d1ec1b tempest-VolumesListAdminTestJSON-1045214710 None] Created volume successfully. Sep 18 23:49:27 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:49:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Flow 'volume_create_manager' (363a648d-502b-4f53-bdc2-7518e1f522b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02dedc09-540e-4eb3-b335-f55bce35fb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02dedc09-540e-4eb3-b335-f55bce35fb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78749db5-2359-42f6-be1e-0be7417ae824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30451313f73e4f39a9b9759e8d4ea000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:28Z,use_quota=True,user_id='a44691e8f0264a6dbd38a10beb043cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105921a9-d1aa-42a0-964c-ddf46c3a9b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105921a9-d1aa-42a0-964c-ddf46c3a9b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4621645b-3052-421b-838f-b2f358752bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4621645b-3052-421b-838f-b2f358752bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78749db5-2359-42f6-be1e-0be7417ae824', 'volume_name': 'volume-78749db5-2359-42f6-be1e-0be7417ae824', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b19129-edeb-424f-b1be-2744714e660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b19129-edeb-424f-b1be-2744714e660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e902fb-61c9-4f41-b4ff-4177fef92ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Volume 78749db5-2359-42f6-be1e-0be7417ae824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78749db5-2359-42f6-be1e-0be7417ae824', 'volume_size': 1} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78749db5-2359-42f6-be1e-0be7417ae824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30451313f73e4f39a9b9759e8d4ea000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:28Z,use_quota=True,user_id='a44691e8f0264a6dbd38a10beb043cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Creating volume 78749db5-2359-42f6-be1e-0be7417ae824 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:49:28 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-78749db5-2359-42f6-be1e-0be7417ae824 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:28 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-78749db5-2359-42f6-be1e-0be7417ae824 1073741824 Sep 18 23:49:28 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:28 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-78749db5-2359-42f6-be1e-0be7417ae824 1073741824" returned: 0 in 0.624s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-78749db5-2359-42f6-be1e-0be7417ae824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:28 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-78749db5-2359-42f6-be1e-0be7417ae824 Sep 18 23:49:28 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Flow 'volume_create_manager' (a2836628-8e21-4831-940e-b72de9026000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8057503d-48a7-4567-bc21-d4b86443f995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:29 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-78749db5-2359-42f6-be1e-0be7417ae824" returned: 0 in 0.380s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8057503d-48a7-4567-bc21-d4b86443f995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-387668087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87da8739-fe46-43f4-bc6d-5b4471d2d9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a00746c912f417bba4d18b6807e2498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:29Z,use_quota=True,user_id='d0b01dfe2e774fb8aba3c7f03bb629e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17857a61-715d-4c19-b176-94184901e480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17857a61-715d-4c19-b176-94184901e480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b83eb64-2562-4e72-b5f0-ab4b1e279a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b83eb64-2562-4e72-b5f0-ab4b1e279a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87da8739-fe46-43f4-bc6d-5b4471d2d9c8', 'volume_name': 'volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52a5004-d2de-4057-aadf-b12806e51b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52a5004-d2de-4057-aadf-b12806e51b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad0a1db-804a-4db4-858e-57f4f98a600a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Volume 87da8739-fe46-43f4-bc6d-5b4471d2d9c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8', 'volume_size': 1} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-387668087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87da8739-fe46-43f4-bc6d-5b4471d2d9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a00746c912f417bba4d18b6807e2498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:29Z,use_quota=True,user_id='d0b01dfe2e774fb8aba3c7f03bb629e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Creating volume 87da8739-fe46-43f4-bc6d-5b4471d2d9c8 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:49:29 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e902fb-61c9-4f41-b4ff-4177fef92ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78749db5-2359-42f6-be1e-0be7417ae824', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fb768f-0032-43e0-98aa-f81533d4a1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:29 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8 1073741824 Sep 18 23:49:29 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Volume volume-78749db5-2359-42f6-be1e-0be7417ae824 (78749db5-2359-42f6-be1e-0be7417ae824): created successfully Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fb768f-0032-43e0-98aa-f81533d4a1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Flow 'volume_create_manager' (363a648d-502b-4f53-bdc2-7518e1f522b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9023151f-33fc-4c52-9e9b-4985e5f84051 tempest-VolumesListAdminTestJSON-1837579930 None] Created volume successfully. Sep 18 23:49:29 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8 1073741824" returned: 0 in 0.469s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:29 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8 Sep 18 23:49:29 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:29 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8" returned: 0 in 0.282s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:49:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad0a1db-804a-4db4-858e-57f4f98a600a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebb9548-4038-4ea5-8b6e-ded4ba0e3c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:30 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Volume volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8 (87da8739-fe46-43f4-bc6d-5b4471d2d9c8): created successfully Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebb9548-4038-4ea5-8b6e-ded4ba0e3c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Flow 'volume_create_manager' (a2836628-8e21-4831-940e-b72de9026000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8ae2d372-64a2-4c39-a45e-835c1476fd4a tempest-AttachVolumeNegativeTest-931395348 None] Created volume successfully. Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Acquiring lock "cinder-78749db5-2359-42f6-be1e-0be7417ae824-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Lock "cinder-78749db5-2359-42f6-be1e-0be7417ae824-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Acquiring lock "cinder-quobyte-78749db5-2359-42f6-be1e-0be7417ae824" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Lock "cinder-quobyte-78749db5-2359-42f6-be1e-0be7417ae824" acquired by "delete_volume" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[291c90f9-498e-4b2b-846d-0697ba44c8d1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-78749db5-2359-42f6-be1e-0be7417ae824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "cinder-5db06524-e3f4-46ff-97eb-8115f87c7d01-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Lock "cinder-5db06524-e3f4-46ff-97eb-8115f87c7d01-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "cinder-quobyte-5db06524-e3f4-46ff-97eb-8115f87c7d01" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Lock "cinder-quobyte-5db06524-e3f4-46ff-97eb-8115f87c7d01" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:30 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-78749db5-2359-42f6-be1e-0be7417ae824 Sep 18 23:49:30 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bfec97-f748-4f21-b52f-32185d97414f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5db06524-e3f4-46ff-97eb-8115f87c7d01 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:30 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5db06524-e3f4-46ff-97eb-8115f87c7d01 Sep 18 23:49:30 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:31 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-78749db5-2359-42f6-be1e-0be7417ae824" returned: 0 in 0.562s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-78749db5-2359-42f6-be1e-0be7417ae824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:31 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-78749db5-2359-42f6-be1e-0be7417ae824 Sep 18 23:49:31 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:31 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5db06524-e3f4-46ff-97eb-8115f87c7d01" returned: 0 in 0.647s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5db06524-e3f4-46ff-97eb-8115f87c7d01 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:31 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5db06524-e3f4-46ff-97eb-8115f87c7d01 Sep 18 23:49:31 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:31 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-78749db5-2359-42f6-be1e-0be7417ae824" returned: 0 in 0.492s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Lock "cinder-quobyte-78749db5-2359-42f6-be1e-0be7417ae824" released by "delete_volume" :: held 1.135s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Created reservations ['70f82445-2fa3-4a80-87f3-f1e6b7bd8117', 'd2bc41b7-d3ba-421e-8760-d7884921257c', '98c316e8-b04a-41ca-b92b-a384fe679a23', '04d16bd0-2d1f-4494-b142-f688d44d6efe'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:31 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5db06524-e3f4-46ff-97eb-8115f87c7d01" returned: 0 in 0.406s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:31 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:49:31 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Lock "cinder-quobyte-5db06524-e3f4-46ff-97eb-8115f87c7d01" released by "delete_volume" :: held 1.156s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:31 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Created reservations ['f973a0a6-46bc-495c-ac49-7540e6734723', 'dfd7f7d0-9aae-4188-bbfa-825b1ebee594', '5d19d268-325d-401f-ac4d-553ce47b6005', '92a0a36e-4714-4322-a902-c565b8a4c747'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:32 devstack sudo[92735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:49:32 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:32 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.439s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:49:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Deleted volume successfully. Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72156bf8-38f8-457f-8523-9cd2738c7554 tempest-VolumesListAdminTestJSON-1837579930 None] Lock "cinder-78749db5-2359-42f6-be1e-0be7417ae824-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:32 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.417s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:49:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Deleted volume successfully. Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-536285ee-14db-4e39-abef-0e1d89e9c5ea tempest-VolumesListAdminTestJSON-1045214710 None] Lock "cinder-5db06524-e3f4-46ff-97eb-8115f87c7d01-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-df006d01-0e78-499e-aecb-d29c65d841d7 req-43ce756a-3c6d-4e67-a490-119ba7b19d8c tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-df006d01-0e78-499e-aecb-d29c65d841d7 req-43ce756a-3c6d-4e67-a490-119ba7b19d8c tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-5a2bca96-943e-462c-b12f-19bd28fad0b8 req-eb5db0c8-9090-464a-bad2-1b7e5aebe9d3 tempest-ServerActionsTestOtherA-2129144877 None] Terminate volume connection completed successfully. Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-5a2bca96-943e-462c-b12f-19bd28fad0b8 req-eb5db0c8-9090-464a-bad2-1b7e5aebe9d3 tempest-ServerActionsTestOtherA-2129144877 None] Deleting attachment 211be340-2ccf-4c76-bc3a-e0204803fc27. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-df006d01-0e78-499e-aecb-d29c65d841d7 req-43ce756a-3c6d-4e67-a490-119ba7b19d8c tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-df006d01-0e78-499e-aecb-d29c65d841d7 req-43ce756a-3c6d-4e67-a490-119ba7b19d8c tempest-AttachVolumeNegativeTest-931395348 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c117bf2-d637-4630-b339-fb85b754d4e1', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:49:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-df006d01-0e78-499e-aecb-d29c65d841d7 req-43ce756a-3c6d-4e67-a490-119ba7b19d8c tempest-AttachVolumeNegativeTest-931395348 None] attachment_update completed successfully. Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "cinder-82f735ba-f694-4c79-ad4f-50edb8f3d135-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Lock "cinder-82f735ba-f694-4c79-ad4f-50edb8f3d135-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "cinder-quobyte-82f735ba-f694-4c79-ad4f-50edb8f3d135" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Lock "cinder-quobyte-82f735ba-f694-4c79-ad4f-50edb8f3d135" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:33 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[967e10ec-f6cd-450d-a100-7cbc30b881ec]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-82f735ba-f694-4c79-ad4f-50edb8f3d135 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:33 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-82f735ba-f694-4c79-ad4f-50edb8f3d135 Sep 18 23:49:33 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:33 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-82f735ba-f694-4c79-ad4f-50edb8f3d135" returned: 0 in 0.580s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-82f735ba-f694-4c79-ad4f-50edb8f3d135 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:33 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-82f735ba-f694-4c79-ad4f-50edb8f3d135 Sep 18 23:49:33 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:34 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-82f735ba-f694-4c79-ad4f-50edb8f3d135" returned: 0 in 0.335s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Lock "cinder-quobyte-82f735ba-f694-4c79-ad4f-50edb8f3d135" released by "delete_volume" :: held 0.984s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:34 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Created reservations ['004c09d5-c443-470a-9a0a-ca6036ca3022', '6bdb68f9-7b1c-4b57-a695-a7e7ea07b2aa', '54c30159-a3cc-45ae-b945-b64ff5820a7c', '42465744-65a4-4a9a-98d1-f8f3effc7d99'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:49:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:34 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:49:34 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:34 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.277s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:34 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:49:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Deleted volume successfully. Sep 18 23:49:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cf2c542f-42e2-4bd5-9cb6-6140b8e39f3d tempest-VolumesListAdminTestJSON-1045214710 None] Lock "cinder-82f735ba-f694-4c79-ad4f-50edb8f3d135-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "cinder-194bc81d-3045-4330-8d4e-c52be2d3f30f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Lock "cinder-194bc81d-3045-4330-8d4e-c52be2d3f30f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "cinder-quobyte-194bc81d-3045-4330-8d4e-c52be2d3f30f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Lock "cinder-quobyte-194bc81d-3045-4330-8d4e-c52be2d3f30f" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:35 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[54742b61-dd16-4dd9-97a0-041ba92980e0]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-194bc81d-3045-4330-8d4e-c52be2d3f30f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-576abfc2-2d36-419b-984b-5a357c4b1fee req-c1a6b15e-ad07-442e-a99f-5cb7ab9ea658 tempest-AttachVolumeNegativeTest-931395348 None] Terminate volume connection completed successfully. Sep 18 23:49:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-576abfc2-2d36-419b-984b-5a357c4b1fee req-c1a6b15e-ad07-442e-a99f-5cb7ab9ea658 tempest-AttachVolumeNegativeTest-931395348 None] Deleting attachment 9c117bf2-d637-4630-b339-fb85b754d4e1. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:49:35 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-194bc81d-3045-4330-8d4e-c52be2d3f30f Sep 18 23:49:35 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:35 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-194bc81d-3045-4330-8d4e-c52be2d3f30f" returned: 0 in 0.397s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-194bc81d-3045-4330-8d4e-c52be2d3f30f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:35 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-194bc81d-3045-4330-8d4e-c52be2d3f30f Sep 18 23:49:35 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:36 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-194bc81d-3045-4330-8d4e-c52be2d3f30f" returned: 0 in 0.302s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Lock "cinder-quobyte-194bc81d-3045-4330-8d4e-c52be2d3f30f" released by "delete_volume" :: held 0.777s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:36 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Created reservations ['84c029f1-b54f-43ad-8dad-15a6a3ea69a5', 'ebca9b97-ff63-45c1-a9ff-272e997c069d', '16b35b44-26da-4132-9fd0-0e620cd11676', '95400686-bcbf-497c-8012-d31bc8d7987f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:49:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:36 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:49:36 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:36 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:36 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:49:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Deleted volume successfully. Sep 18 23:49:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1dcf47e6-1867-46a4-834a-8dc4e8bb0a41 tempest-VolumesListAdminTestJSON-1045214710 None] Lock "cinder-194bc81d-3045-4330-8d4e-c52be2d3f30f-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "cinder-87da8739-fe46-43f4-bc6d-5b4471d2d9c8-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Lock "cinder-87da8739-fe46-43f4-bc6d-5b4471d2d9c8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "cinder-quobyte-87da8739-fe46-43f4-bc6d-5b4471d2d9c8" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Lock "cinder-quobyte-87da8739-fe46-43f4-bc6d-5b4471d2d9c8" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e422561-accd-4efc-8e5a-5d1502c83d57]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Flow 'volume_create_manager' (1a983a92-a3cf-49ec-8688-1dd320db576a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22a215e-93e1-46ad-9333-df3fce085979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22a215e-93e1-46ad-9333-df3fce085979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-502056870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a909b28d28d4231bfc2327005575b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:41Z,use_quota=True,user_id='d53dd4811360410392ce45a2c3038583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37f4dae-ed66-46ab-8136-6ebaf360d6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37f4dae-ed66-46ab-8136-6ebaf360d6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739e7dbb-d10e-4d8c-9937-fc780f9f8c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 23:49:41 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8 Sep 18 23:49:41 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:41 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8" returned: 0 in 0.402s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:41 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8 Sep 18 23:49:41 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:41 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87da8739-fe46-43f4-bc6d-5b4471d2d9c8" returned: 0 in 0.261s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Lock "cinder-quobyte-87da8739-fe46-43f4-bc6d-5b4471d2d9c8" released by "delete_volume" :: held 0.712s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Created reservations ['6de2b500-c426-45e2-b921-86a7b1f636c0', 'dcf6e10c-2a05-4a3b-9880-55bcd65b5d2e', 'fa2772ab-ec4b-45aa-b5ed-e72dc4347c59', '8e1db856-e268-4143-8556-17c453e0ac0d'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739e7dbb-d10e-4d8c-9937-fc780f9f8c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5', 'volume_name': 'volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b36168d-042e-4af7-a46b-cb20543469eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b36168d-042e-4af7-a46b-cb20543469eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32798ed3-66a9-4d1f-9e42-70098868383c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:41 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Volume 22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Trying to clone 22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 from image 4b54cd3f-793e-47ca-910a-79fe5da0114d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:41 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:49:41 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "cinder-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:42 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.406s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 23:49:42 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Image download 20.69 MB at 20.69 MB/s Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Lock "cinder-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Deleted volume successfully. Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-63fd8aa5-a166-46ff-895f-665e0be1e47b tempest-AttachVolumeNegativeTest-931395348 None] Lock "cinder-87da8739-fe46-43f4-bc6d-5b4471d2d9c8-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "cinder-quobyte-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bf7671-aa2b-41eb-966f-cbb61828c6c5]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Lock "cinder-quobyte-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f90109-eb7a-4668-aebf-4959a2f48d29]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:42 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD Sep 18 23:49:42 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:42 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0 Sep 18 23:49:42 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:42 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Temporary image 4b54cd3f-793e-47ca-910a-79fe5da0114d is fetched for user d53dd4811360410392ce45a2c3038583. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 23:49:42 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0" returned: 0 in 0.424s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d055b472-38f0-44f7-a55d-8da044dd7f71]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:42 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0 Sep 18 23:49:42 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:43 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD Sep 18 23:49:43 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:43 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0" returned: 0 in 0.399s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:43 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-502056870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a909b28d28d4231bfc2327005575b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:41Z,use_quota=True,user_id='d53dd4811360410392ce45a2c3038583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Creating volume 22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:49:43 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Lock "cinder-quobyte-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0" released by "delete_volume" :: held 0.909s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:43 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 1073741824 Sep 18 23:49:43 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Flow 'volume_create_manager' (d965adb5-62a4-4acc-8af6-1ec2edb33101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67478e04-5f86-474a-895d-d2d5fefa008d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67478e04-5f86-474a-895d-d2d5fefa008d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1326693410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1adaef-bead-46a9-a4bb-136c3d643143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27764810b078481792499d566551908f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:43Z,use_quota=True,user_id='75a621b9f67f46ab8b55be38e4939833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65bf47a-a925-45a9-ac33-230878d68bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65bf47a-a925-45a9-ac33-230878d68bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169a7d56-d57f-4dd9-b8db-9ab7f5b1fdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Created reservations ['ac81db1a-8034-459c-9420-a90688a996d0', 'e3cf26cf-8c13-4970-aecd-38312c796ba0', 'e79d7250-8e55-4f49-8c7d-2c7be6ec206f', '52027a11-d9a0-46eb-9d2f-c68101a5c017'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:43 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:49:43 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169a7d56-d57f-4dd9-b8db-9ab7f5b1fdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc1adaef-bead-46a9-a4bb-136c3d643143', 'volume_name': 'volume-dc1adaef-bead-46a9-a4bb-136c3d643143', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf57521f-b591-4ee8-a7ec-a9f6a3e50cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf57521f-b591-4ee8-a7ec-a9f6a3e50cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd88d4bd-0eaf-45b3-bb14-2eacbe20f0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Volume dc1adaef-bead-46a9-a4bb-136c3d643143: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc1adaef-bead-46a9-a4bb-136c3d643143', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Trying to clone dc1adaef-bead-46a9-a4bb-136c3d643143 from image 4b54cd3f-793e-47ca-910a-79fe5da0114d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 23:49:43 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:43 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.299s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 1073741824" returned: 0 in 0.589s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Deleted volume successfully. Sep 18 23:49:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-11904cdd-269c-4067-ae97-efaae3496ce0 tempest-AttachVolumeNegativeTest-931395348 None] Lock "cinder-e92e43c1-8cc5-4fbf-a7f9-8b5519664eb0-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:44 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 Sep 18 23:49:44 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:44 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 23:49:44 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Image download 20.69 MB at 20.69 MB/s Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5" returned: 0 in 0.306s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Attempting download of 4b54cd3f-793e-47ca-910a-79fe5da0114d ((None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}])) to volume 22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb37fda7-13cc-490a-804e-4d3ba81563c8]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[af131023-e821-4b8e-b898-1cc4158a6d39]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_gomp0u6l {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:44 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD Sep 18 23:49:44 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:44 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_gomp0u6l Sep 18 23:49:44 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:44 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Temporary image 4b54cd3f-793e-47ca-910a-79fe5da0114d is fetched for user 75a621b9f67f46ab8b55be38e4939833. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 23:49:44 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_gomp0u6l" returned: 0 in 0.355s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_gomp0u6l {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "cinder-cd71d45e-9855-441d-8c13-f8438ff4e754-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Lock "cinder-cd71d45e-9855-441d-8c13-f8438ff4e754-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e57b5ee-97e4-4540-8e5a-c5abfd18dc53]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:44 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_gomp0u6l Sep 18 23:49:44 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "cinder-quobyte-cd71d45e-9855-441d-8c13-f8438ff4e754" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Lock "cinder-quobyte-cd71d45e-9855-441d-8c13-f8438ff4e754" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae5904d-58ff-42b4-8694-7bbfc5c4d01b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cd71d45e-9855-441d-8c13-f8438ff4e754 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:44 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD Sep 18 23:49:44 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:45 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cd71d45e-9855-441d-8c13-f8438ff4e754 Sep 18 23:49:45 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:45 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_gomp0u6l" returned: 1 in 0.351s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_gomp0u6l' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84975f2-c7bc-4d87-aced-be47fd3e5f47]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:45 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1326693410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1adaef-bead-46a9-a4bb-136c3d643143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27764810b078481792499d566551908f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:49:43Z,use_quota=True,user_id='75a621b9f67f46ab8b55be38e4939833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Creating volume dc1adaef-bead-46a9-a4bb-136c3d643143 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:49:45 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:45 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD Sep 18 23:49:45 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:45 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 1073741824 Sep 18 23:49:45 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:45 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cd71d45e-9855-441d-8c13-f8438ff4e754" returned: 0 in 0.403s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cd71d45e-9855-441d-8c13-f8438ff4e754 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:45 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cd71d45e-9855-441d-8c13-f8438ff4e754 Sep 18 23:49:45 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:45 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD" returned: 0 in 0.377s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] 4b54cd3f-793e-47ca-910a-79fe5da0114d was qcow2, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:45 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 Sep 18 23:49:45 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:45 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cd71d45e-9855-441d-8c13-f8438ff4e754" returned: 0 in 0.259s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Lock "cinder-quobyte-cd71d45e-9855-441d-8c13-f8438ff4e754" released by "delete_volume" :: held 0.712s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Created reservations ['8fefa00f-8931-439f-b0b2-07e343dd08b2', '3a525b04-6257-4d16-bde9-211f0696d317', '48140020-3d75-4963-8456-016f15a329ae', '78446ca0-027a-4ac2-afd7-4054e2434379'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:49:45 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 1073741824" returned: 0 in 0.487s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:45 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 Sep 18 23:49:45 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:45 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:49:45 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:46 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143" returned: 0 in 0.274s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:49:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:46 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Attempting download of 4b54cd3f-793e-47ca-910a-79fe5da0114d ((None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}])) to volume dc1adaef-bead-46a9-a4bb-136c3d643143. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 23:49:46 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.325s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:46 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:49:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Deleted volume successfully. Sep 18 23:49:46 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8500cb26-572a-4e6d-934e-36f91032a93b]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_uayhi2g5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1a4077dd-3ee3-42d5-b289-2ff8eabe2220 tempest-AttachVolumeNegativeTest-931395348 None] Lock "cinder-cd71d45e-9855-441d-8c13-f8438ff4e754-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:46 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_uayhi2g5 Sep 18 23:49:46 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:46 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_uayhi2g5" returned: 0 in 0.476s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_uayhi2g5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:46 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_uayhi2g5 Sep 18 23:49:46 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:47 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_uayhi2g5" returned: 1 in 0.412s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_uayhi2g5' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 23:49:47 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c645e2-ccc6-43ff-9e31-09cd86a6c69f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:47 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD Sep 18 23:49:47 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:47 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:47 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] 4b54cd3f-793e-47ca-910a-79fe5da0114d was qcow2, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 23:49:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:47 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 Sep 18 23:49:47 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:47 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5" returned: 0 in 2.196s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:47 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ht05i7b3devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:49:47 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Converted 112.00 MB image at 50.96 MB/s Sep 18 23:49:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:47 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 1G Sep 18 23:49:47 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:48 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 1G" returned: 0 in 0.393s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:48 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Downloaded image 4b54cd3f-793e-47ca-910a-79fe5da0114d ((None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}])) to volume 22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 23:49:48 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Temporary image 4b54cd3f-793e-47ca-910a-79fe5da0114d for user d53dd4811360410392ce45a2c3038583 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 23:49:48 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Marking volume 22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 23:49:48 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Copying metadata from image 4b54cd3f-793e-47ca-910a-79fe5da0114d to 22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 23:49:48 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Creating volume glance metadata for volume 22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 backed by image 4b54cd3f-793e-47ca-910a-79fe5da0114d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 23:49:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32798ed3-66a9-4d1f-9e42-70098868383c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d0b32f-8e30-4bf2-8f2c-5eef1e655da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:48 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Volume volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 (22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5): created successfully Sep 18 23:49:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d0b32f-8e30-4bf2-8f2c-5eef1e655da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Flow 'volume_create_manager' (1a983a92-a3cf-49ec-8688-1dd320db576a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d217e020-b79d-40ba-907a-adca6c7246f5 tempest-ServerActionsTestOtherA-2129144877 None] Created volume successfully. Sep 18 23:49:49 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143" returned: 0 in 2.106s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:49 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_2obecu1ydevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:49:49 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Converted 112.00 MB image at 53.15 MB/s Sep 18 23:49:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:49 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 1G Sep 18 23:49:49 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:49 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 1G" returned: 0 in 0.453s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:49 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Downloaded image 4b54cd3f-793e-47ca-910a-79fe5da0114d ((None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}])) to volume dc1adaef-bead-46a9-a4bb-136c3d643143 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 23:49:50 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Temporary image 4b54cd3f-793e-47ca-910a-79fe5da0114d for user 75a621b9f67f46ab8b55be38e4939833 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 23:49:50 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Marking volume dc1adaef-bead-46a9-a4bb-136c3d643143 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 23:49:50 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Copying metadata from image 4b54cd3f-793e-47ca-910a-79fe5da0114d to dc1adaef-bead-46a9-a4bb-136c3d643143. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 23:49:50 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Creating volume glance metadata for volume dc1adaef-bead-46a9-a4bb-136c3d643143 backed by image 4b54cd3f-793e-47ca-910a-79fe5da0114d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 23:49:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd88d4bd-0eaf-45b3-bb14-2eacbe20f0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1adaef-bead-46a9-a4bb-136c3d643143', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5a5f21-caf3-4c10-9110-0136299405e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:49:50 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Volume volume-dc1adaef-bead-46a9-a4bb-136c3d643143 (dc1adaef-bead-46a9-a4bb-136c3d643143): created successfully Sep 18 23:49:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5a5f21-caf3-4c10-9110-0136299405e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:49:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Flow 'volume_create_manager' (d965adb5-62a4-4acc-8af6-1ec2edb33101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:49:50 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-012f0769-3345-4f7f-8dae-0e131fb07b4b tempest-VolumesImageMetadata-56757542 None] Created volume successfully. Sep 18 23:49:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Acquiring lock "cinder-dc1adaef-bead-46a9-a4bb-136c3d643143-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Lock "cinder-dc1adaef-bead-46a9-a4bb-136c3d643143-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Acquiring lock "cinder-quobyte-dc1adaef-bead-46a9-a4bb-136c3d643143" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:49:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Lock "cinder-quobyte-dc1adaef-bead-46a9-a4bb-136c3d643143" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:49:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[88689089-b761-4d50-b4e7-b085989c40e1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:49:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:51 devstack sudo[93009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 Sep 18 23:49:51 devstack sudo[93009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:52 devstack sudo[93009]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143" returned: 0 in 0.489s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:52 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143 Sep 18 23:49:52 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-be024d5c-e3bb-4831-a1ab-369c4d3ae24a req-68989d94-7042-45bb-bfb4-293061654261 tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-be024d5c-e3bb-4831-a1ab-369c4d3ae24a req-68989d94-7042-45bb-bfb4-293061654261 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-be024d5c-e3bb-4831-a1ab-369c4d3ae24a req-68989d94-7042-45bb-bfb4-293061654261 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-be024d5c-e3bb-4831-a1ab-369c4d3ae24a req-68989d94-7042-45bb-bfb4-293061654261 tempest-ServerActionsTestOtherA-2129144877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '589a5665-d7e3-4bb7-ad09-739ff245b443', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:49:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-be024d5c-e3bb-4831-a1ab-369c4d3ae24a req-68989d94-7042-45bb-bfb4-293061654261 tempest-ServerActionsTestOtherA-2129144877 None] attachment_update completed successfully. Sep 18 23:49:52 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc1adaef-bead-46a9-a4bb-136c3d643143" returned: 0 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Lock "cinder-quobyte-dc1adaef-bead-46a9-a4bb-136c3d643143" released by "delete_volume" :: held 0.914s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Created reservations ['76729300-1128-459d-a012-d81f0a15b523', '4ada2aff-ea28-4f41-8448-42005d47842c', 'a29691cc-cb62-4398-a36f-6494643d33b2', 'a950a21d-53d6-4f15-8633-026a98aec00a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:49:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:49:52 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:49:52 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:49:53 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Sep 18 23:49:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.352s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:49:53 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:49:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Deleted volume successfully. Sep 18 23:49:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c3b7072e-5377-4151-81c5-db77f71f2bab tempest-VolumesImageMetadata-56757542 None] Lock "cinder-dc1adaef-bead-46a9-a4bb-136c3d643143-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:49:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-c79b3bf6-09e4-4787-a6e9-d44489723094 req-7cf71551-1e99-43bd-b287-35602827a3b3 tempest-AttachVolumeTestJSON-268412481 None] Terminate volume connection completed successfully. Sep 18 23:49:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-c79b3bf6-09e4-4787-a6e9-d44489723094 req-7cf71551-1e99-43bd-b287-35602827a3b3 tempest-AttachVolumeTestJSON-268412481 None] Deleting attachment 322e2125-d1b2-4dee-a3c6-52a47efca59e. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Flow 'volume_create_manager' (71091cfd-3ab2-43d7-8fd6-c6f0b8876b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a9dc2f-d63a-4a5b-b036-2961f90adf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a9dc2f-d63a-4a5b-b036-2961f90adf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1284944112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d72f43-70e0-46c8-9f15-963fa19eee48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98758b5be8244bedb25e4e37b5b75a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:50:00Z,use_quota=True,user_id='970f93dcf7424577b92a41a1d8970f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b294d3-da28-4e1a-b70a-65c92812c376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b294d3-da28-4e1a-b70a-65c92812c376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdeabdca-b60a-4746-b113-d0c98e017285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdeabdca-b60a-4746-b113-d0c98e017285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d72f43-70e0-46c8-9f15-963fa19eee48', 'volume_name': 'volume-47d72f43-70e0-46c8-9f15-963fa19eee48', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0289485-2f56-47fd-9233-4f2dc5a005fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0289485-2f56-47fd-9233-4f2dc5a005fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0a8cb5-bfd3-4d17-96da-5cc4ed349fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Volume 47d72f43-70e0-46c8-9f15-963fa19eee48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d72f43-70e0-46c8-9f15-963fa19eee48', 'volume_size': 1} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1284944112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d72f43-70e0-46c8-9f15-963fa19eee48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98758b5be8244bedb25e4e37b5b75a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:50:00Z,use_quota=True,user_id='970f93dcf7424577b92a41a1d8970f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Creating volume 47d72f43-70e0-46c8-9f15-963fa19eee48 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:50:00 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:50:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:00 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 1073741824 Sep 18 23:50:00 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 1073741824" returned: 0 in 1.441s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:01 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:01 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 Sep 18 23:50:01 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:02 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48" returned: 0 in 0.529s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:50:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0a8cb5-bfd3-4d17-96da-5cc4ed349fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d72f43-70e0-46c8-9f15-963fa19eee48', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5dc503-beb9-4d02-a027-2a8dc78d9a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Volume volume-47d72f43-70e0-46c8-9f15-963fa19eee48 (47d72f43-70e0-46c8-9f15-963fa19eee48): created successfully Sep 18 23:50:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5dc503-beb9-4d02-a027-2a8dc78d9a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Flow 'volume_create_manager' (71091cfd-3ab2-43d7-8fd6-c6f0b8876b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:50:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2f808647-c9ba-4ceb-95cd-44b82c93e761 tempest-SnapshotMetadataTestJSON-1685507177 None] Created volume successfully. Sep 18 23:50:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] Creating offline snapshot 24fad34e-f525-45c8-b119-19b4e4f79a46 of volume 47d72f43-70e0-46c8-9f15-963fa19eee48 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:50:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b293138-f082-4e40-86c0-a59db07dc56c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:50:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:04 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 Sep 18 23:50:04 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:05 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48" returned: 0 in 1.122s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:05 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 1G Sep 18 23:50:05 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:06 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 1G" returned: 0 in 0.654s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d72f43-70e0-46c8-9f15-963fa19eee48 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:06 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d72f43-70e0-46c8-9f15-963fa19eee48 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 Sep 18 23:50:06 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-10c1c565-6423-417d-ad45-3b5299b4b123 tempest-BackendsCapabilitiesAdminTestsJSON-798078923 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6891326904297, 'free_capacity_gb': 1775.6891326904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85963) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 18 23:50:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ce7e7c6c-4379-45f4-9257-8cb3bb327440 tempest-BackendsCapabilitiesAdminTestsJSON-798078923 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6891326904297, 'free_capacity_gb': 1775.6891326904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85963) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 18 23:50:07 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d72f43-70e0-46c8-9f15-963fa19eee48 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46" returned: 0 in 0.992s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:07 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 is being set with open permissions: ugo+rw Sep 18 23:50:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:07 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 Sep 18 23:50:07 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:08 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46" returned: 0 in 0.737s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:08 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.info Sep 18 23:50:08 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:08 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.info" returned: 0 in 0.606s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:08 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.info is being set with open permissions: ugo+rw Sep 18 23:50:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:08 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.info Sep 18 23:50:08 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:09 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.info" returned: 0 in 0.332s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.708s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-692add77-739a-4987-b533-53846f12ac44 tempest-SnapshotMetadataTestJSON-1685507177 None] Create snapshot completed successfully Sep 18 23:50:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Acquiring lock "cinder-24fad34e-f525-45c8-b119-19b4e4f79a46-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "cinder-24fad34e-f525-45c8-b119-19b4e4f79a46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Acquiring lock "cinder-quobyte-47d72f43-70e0-46c8-9f15-963fa19eee48" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "cinder-quobyte-47d72f43-70e0-46c8-9f15-963fa19eee48" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Acquiring lock "cinder-quobyte-24fad34e-f525-45c8-b119-19b4e4f79a46" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "cinder-quobyte-24fad34e-f525-45c8-b119-19b4e4f79a46" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Deleting offline snapshot 24fad34e-f525-45c8-b119-19b4e4f79a46 of volume 47d72f43-70e0-46c8-9f15-963fa19eee48 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:50:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] snapshot_file for this snap is: volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:50:11 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a796f735-a3d8-45c5-abdc-75c1ba911969]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:50:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:11 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 Sep 18 23:50:11 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:12 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46" returned: 0 in 0.599s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d72f43-70e0-46c8-9f15-963fa19eee48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:50:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-0f82697f-12d0-4392-aec0-7a129c3c0c45 req-9256852e-b0e1-45e4-a36a-5a7eaf1d4fc4 tempest-ServerActionsTestOtherA-2129144877 None] Terminate volume connection completed successfully. Sep 18 23:50:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-0f82697f-12d0-4392-aec0-7a129c3c0c45 req-9256852e-b0e1-45e4-a36a-5a7eaf1d4fc4 tempest-ServerActionsTestOtherA-2129144877 None] Deleting attachment 589a5665-d7e3-4bb7-ad09-739ff245b443. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:50:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cf287e-57fc-4a70-bc2c-9a6edecf23b8]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:50:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:12 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 Sep 18 23:50:12 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:12 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48" returned: 0 in 0.589s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:13 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 Sep 18 23:50:13 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:13 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46" returned: 0 in 0.512s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:13 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46 Sep 18 23:50:13 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:13 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48.24fad34e-f525-45c8-b119-19b4e4f79a46" returned: 0 in 0.420s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "cinder-quobyte-24fad34e-f525-45c8-b119-19b4e4f79a46" released by "_delete_snapshot" :: held 2.368s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "cinder-quobyte-47d72f43-70e0-46c8-9f15-963fa19eee48" released by "delete_snapshot" :: held 2.398s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:14 devstack cinder-volume[85963]: WARNING cinder.quota [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:50:14 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Created reservations ['c97471a0-6eda-441e-b15c-51302c2a4969', 'c21aee27-5bb5-4046-9796-ab86b4416765', '6dc31ce0-6e58-48a8-8a9d-247aed2ed8fa', '5c01fa72-a1e7-4913-8b5e-7336e0243ce6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:50:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Delete snapshot completed successfully. Sep 18 23:50:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a351c099-85f4-4f1e-8084-fb00dae5cb96 tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "cinder-24fad34e-f525-45c8-b119-19b4e4f79a46-delete_snapshot" released by "delete_snapshot" :: held 2.616s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-0f82697f-12d0-4392-aec0-7a129c3c0c45 req-16f676b6-694b-41c2-8532-c8b4bff5f9c4 tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-0f82697f-12d0-4392-aec0-7a129c3c0c45 req-16f676b6-694b-41c2-8532-c8b4bff5f9c4 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-0f82697f-12d0-4392-aec0-7a129c3c0c45 req-16f676b6-694b-41c2-8532-c8b4bff5f9c4 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-0f82697f-12d0-4392-aec0-7a129c3c0c45 req-16f676b6-694b-41c2-8532-c8b4bff5f9c4 tempest-ServerActionsTestOtherA-2129144877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7eda35f8-a783-4a69-a438-cbafa41a9f7d', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:50:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-0f82697f-12d0-4392-aec0-7a129c3c0c45 req-16f676b6-694b-41c2-8532-c8b4bff5f9c4 tempest-ServerActionsTestOtherA-2129144877 None] attachment_update completed successfully. Sep 18 23:50:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Acquiring lock "cinder-47d72f43-70e0-46c8-9f15-963fa19eee48-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "cinder-47d72f43-70e0-46c8-9f15-963fa19eee48-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Acquiring lock "cinder-quobyte-47d72f43-70e0-46c8-9f15-963fa19eee48" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "cinder-quobyte-47d72f43-70e0-46c8-9f15-963fa19eee48" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfe4ce6-cc85-46b8-8c15-260bbc95e6be]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:50:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:15 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 Sep 18 23:50:15 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:15 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48" returned: 0 in 0.820s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:15 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48 Sep 18 23:50:15 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:16 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-47d72f43-70e0-46c8-9f15-963fa19eee48" returned: 0 in 0.398s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "cinder-quobyte-47d72f43-70e0-46c8-9f15-963fa19eee48" released by "delete_volume" :: held 1.324s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:16 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Created reservations ['f0a0d575-c321-451f-b4f2-3d179264d64a', '87911a21-4788-4d56-8996-dbf561bed0c3', '5b5c7ae9-6d3d-4aba-8796-d9ceca4e8768', '5ca6e0c5-d1df-4e91-8a62-04c19375c21b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:50:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:50:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:50:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:16 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:50:16 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:16 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.424s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:17 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:50:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Deleted volume successfully. Sep 18 23:50:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7796119e-2977-47b8-9e85-2b276fef3aeb tempest-SnapshotMetadataTestJSON-1685507177 None] Lock "cinder-47d72f43-70e0-46c8-9f15-963fa19eee48-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:18 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=113,cinder:UPDATE=104,cinder:INSERT=42,cinder:DELETE=9 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:50:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6b78cb33-b064-4714-935d-eef9f1fa1b31 tempest-GroupSnapshotsV319Test-1228957703 None] Group tempest-GroupSnapshotsV319Test-Group-1272847036: creating Sep 18 23:50:18 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=107,cinder:UPDATE=118,cinder:DELETE=9,cinder:INSERT=33 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:50:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6b78cb33-b064-4714-935d-eef9f1fa1b31 tempest-GroupSnapshotsV319Test-1228957703 None] Group tempest-GroupSnapshotsV319Test-Group-1272847036: created successfully Sep 18 23:50:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6b78cb33-b064-4714-935d-eef9f1fa1b31 tempest-GroupSnapshotsV319Test-1228957703 None] Create group completed successfully. Sep 18 23:50:20 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Flow 'volume_create_manager' (df6f2cdd-58f1-40a6-8d69-3f8990a8857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44c5cd2-7d6d-4f9c-81fe-976fb637808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44c5cd2-7d6d-4f9c-81fe-976fb637808f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1743440393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=839d1f9d-1dd2-4402-bea6-8f0c550a4ee5,host='devstack@QuobyteHD#QuobyteHD',id=8b6efca9-4a32-4c43-9a4e-3fef95c7c930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d7d65a58f34942bebaa52f68d073e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:50:21Z,use_quota=True,user_id='8f20743b9c884abcb1e6e51e630e64a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8058eb6-d53a-4d7b-bcf8-fda14ee61a19),volume_type_id=d8058eb6-d53a-4d7b-bcf8-fda14ee61a19)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4da16f7-2314-4a60-923f-0f23aeeb8111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4da16f7-2314-4a60-923f-0f23aeeb8111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2287f5-1e46-429a-b91d-683e3165b8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2287f5-1e46-429a-b91d-683e3165b8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6efca9-4a32-4c43-9a4e-3fef95c7c930', 'volume_name': 'volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca51d3b4-07d9-4a7c-bda3-e9bf58518668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca51d3b4-07d9-4a7c-bda3-e9bf58518668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de377a7f-bb0e-4a20-aa90-c434324c0b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Volume 8b6efca9-4a32-4c43-9a4e-3fef95c7c930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930', 'volume_size': 1} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=839d1f9d-1dd2-4402-bea6-8f0c550a4ee5,created_at=2026-09-18T21:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1743440393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=839d1f9d-1dd2-4402-bea6-8f0c550a4ee5,host='devstack@QuobyteHD#QuobyteHD',id=8b6efca9-4a32-4c43-9a4e-3fef95c7c930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d7d65a58f34942bebaa52f68d073e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:50:21Z,use_quota=True,user_id='8f20743b9c884abcb1e6e51e630e64a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8058eb6-d53a-4d7b-bcf8-fda14ee61a19),volume_type_id=d8058eb6-d53a-4d7b-bcf8-fda14ee61a19)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Creating volume 8b6efca9-4a32-4c43-9a4e-3fef95c7c930 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:50:21 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:21 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 1073741824 Sep 18 23:50:21 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:21 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:50:21 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:21 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.448s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:50:21 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 1073741824" returned: 0 in 0.725s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:21 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 Sep 18 23:50:21 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:22 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930" returned: 0 in 0.408s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:50:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de377a7f-bb0e-4a20-aa90-c434324c0b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01defda2-6b40-4847-b2ef-239baa47d1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Volume volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 (8b6efca9-4a32-4c43-9a4e-3fef95c7c930): created successfully Sep 18 23:50:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01defda2-6b40-4847-b2ef-239baa47d1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Flow 'volume_create_manager' (df6f2cdd-58f1-40a6-8d69-3f8990a8857c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:50:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1f600a58-ea34-483a-b843-7e779a4a316f tempest-GroupSnapshotsV319Test-1228957703 None] Created volume successfully. Sep 18 23:50:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] GroupSnapshot 7ca36ea0-c037-4554-b7ae-c202ad435499: creating. Sep 18 23:50:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] Group snapshot 7ca36ea0-c037-4554-b7ae-c202ad435499: creating. {{(pid=85963) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 18 23:50:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] Creating offline snapshot 801b3bf1-32d2-43a5-b495-866eaa1b556b of volume 8b6efca9-4a32-4c43-9a4e-3fef95c7c930 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:50:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff3bac2-5649-47c8-9355-24ab1e1794ea]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:50:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:24 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 Sep 18 23:50:24 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:24 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930" returned: 0 in 0.517s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:24 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b 1G Sep 18 23:50:24 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:25 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b 1G" returned: 0 in 0.505s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:25 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b Sep 18 23:50:25 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Flow 'volume_create_manager' (99af21c7-f41d-4f99-a7f2-9bb11c9e4f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16feb055-5930-4743-8be5-760aa6500f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16feb055-5930-4743-8be5-760aa6500f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1077619956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a7479a-3330-4f9d-89ed-919be3fa181b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecd8def8a944c3d94b18b91622ef78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:50:25Z,use_quota=True,user_id='dd2076e55eaf4dc0ac4d8ff5acd65989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fa76bc-bc7e-4fa0-b274-d4f035be07c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fa76bc-bc7e-4fa0-b274-d4f035be07c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94af94fc-0e0c-4458-92b8-eb134d2c57d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94af94fc-0e0c-4458-92b8-eb134d2c57d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a7479a-3330-4f9d-89ed-919be3fa181b', 'volume_name': 'volume-c7a7479a-3330-4f9d-89ed-919be3fa181b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda82f23-1598-4d4a-9f65-400e5f13f857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:25 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda82f23-1598-4d4a-9f65-400e5f13f857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff10b83a-eff3-403f-8b17-3d692f3b87a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Volume c7a7479a-3330-4f9d-89ed-919be3fa181b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a7479a-3330-4f9d-89ed-919be3fa181b', 'volume_size': 1} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b" returned: 0 in 0.349s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:25 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:25 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b Sep 18 23:50:25 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:25 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b" returned: 0 in 0.248s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:25 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.info Sep 18 23:50:25 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:25 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.info" returned: 0 in 0.250s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:25 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:50:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:26 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.info Sep 18 23:50:26 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:26 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.info" returned: 0 in 0.257s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1077619956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a7479a-3330-4f9d-89ed-919be3fa181b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecd8def8a944c3d94b18b91622ef78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:50:25Z,use_quota=True,user_id='dd2076e55eaf4dc0ac4d8ff5acd65989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Creating volume c7a7479a-3330-4f9d-89ed-919be3fa181b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:50:26 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c7a7479a-3330-4f9d-89ed-919be3fa181b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:26 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c7a7479a-3330-4f9d-89ed-919be3fa181b 1073741824 Sep 18 23:50:26 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6bad17d9-147b-4022-8e94-5d4de6208fcc tempest-GroupSnapshotsV319Test-1228957703 None] group_snapshot 7ca36ea0-c037-4554-b7ae-c202ad435499: created successfully Sep 18 23:50:26 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c7a7479a-3330-4f9d-89ed-919be3fa181b 1073741824" returned: 0 in 0.431s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c7a7479a-3330-4f9d-89ed-919be3fa181b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:26 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c7a7479a-3330-4f9d-89ed-919be3fa181b Sep 18 23:50:26 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:26 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c7a7479a-3330-4f9d-89ed-919be3fa181b" returned: 0 in 0.244s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:50:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff10b83a-eff3-403f-8b17-3d692f3b87a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a7479a-3330-4f9d-89ed-919be3fa181b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02288e3-ee5d-4ba9-9ebe-f3d3a1091279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:27 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Volume volume-c7a7479a-3330-4f9d-89ed-919be3fa181b (c7a7479a-3330-4f9d-89ed-919be3fa181b): created successfully Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02288e3-ee5d-4ba9-9ebe-f3d3a1091279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Flow 'volume_create_manager' (99af21c7-f41d-4f99-a7f2-9bb11c9e4f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:50:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7c13ff99-8783-41bc-bd32-39b7b6ecc9b7 tempest-VolumesTransfersTest-1088616814 None] Created volume successfully. Sep 18 23:50:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] group_snapshot 7ca36ea0-c037-4554-b7ae-c202ad435499: deleting Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] group_snapshot 7ca36ea0-c037-4554-b7ae-c202ad435499: deleting {{(pid=85963) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Acquiring lock "cinder-quobyte-8b6efca9-4a32-4c43-9a4e-3fef95c7c930" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Lock "cinder-quobyte-8b6efca9-4a32-4c43-9a4e-3fef95c7c930" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Acquiring lock "cinder-quobyte-801b3bf1-32d2-43a5-b495-866eaa1b556b" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Lock "cinder-quobyte-801b3bf1-32d2-43a5-b495-866eaa1b556b" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Deleting offline snapshot 801b3bf1-32d2-43a5-b495-866eaa1b556b of volume 8b6efca9-4a32-4c43-9a4e-3fef95c7c930 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] snapshot_file for this snap is: volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d630f108-447e-48f2-bfa6-dd94db1cc3e8]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:50:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:28 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b Sep 18 23:50:28 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5f8ad41f-0ee4-43a9-b84c-73baf64879e3 tempest-VolumesTransfersTest-925984927 None] Transfer volume completed successfully. Sep 18 23:50:28 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b" returned: 0 in 0.639s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:50:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98258af-643b-4ec3-8fa8-cdd8a32aef91]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:50:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:28 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 Sep 18 23:50:28 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:29 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930" returned: 0 in 0.495s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:29 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b Sep 18 23:50:29 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Acquiring lock "cinder-c7a7479a-3330-4f9d-89ed-919be3fa181b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Lock "cinder-c7a7479a-3330-4f9d-89ed-919be3fa181b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Acquiring lock "cinder-quobyte-c7a7479a-3330-4f9d-89ed-919be3fa181b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Lock "cinder-quobyte-c7a7479a-3330-4f9d-89ed-919be3fa181b" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e68a2a6-5123-4c5d-84f9-fd851ddfe53e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c7a7479a-3330-4f9d-89ed-919be3fa181b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:29 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c7a7479a-3330-4f9d-89ed-919be3fa181b Sep 18 23:50:29 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:29 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b" returned: 0 in 0.428s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:29 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b Sep 18 23:50:29 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:29 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c7a7479a-3330-4f9d-89ed-919be3fa181b" returned: 0 in 0.420s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c7a7479a-3330-4f9d-89ed-919be3fa181b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:29 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c7a7479a-3330-4f9d-89ed-919be3fa181b Sep 18 23:50:29 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:29 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930.801b3bf1-32d2-43a5-b495-866eaa1b556b" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Lock "cinder-quobyte-801b3bf1-32d2-43a5-b495-866eaa1b556b" released by "_delete_snapshot" :: held 2.015s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Lock "cinder-quobyte-8b6efca9-4a32-4c43-9a4e-3fef95c7c930" released by "delete_snapshot" :: held 2.067s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:29 devstack cinder-volume[85963]: WARNING cinder.quota [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-444568865 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-444568865, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:50:29 devstack cinder-volume[85963]: WARNING cinder.quota [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-444568865 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-444568865, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] Created reservations ['2dbcbd32-7207-4b27-8a7e-f1dfbc8cfcad', '256ad7e5-16b6-42f7-bd03-030c630dce45', '0bbd2763-d0e8-4342-8dba-ea98ba8bfc74', 'd444322a-74a9-4004-afaa-f08eddfbeca0'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:50:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c602cfb6-682e-4445-a136-c749bf2f907f tempest-GroupSnapshotsV319Test-1228957703 None] group_snapshot 7ca36ea0-c037-4554-b7ae-c202ad435499: deleted successfully Sep 18 23:50:30 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c7a7479a-3330-4f9d-89ed-919be3fa181b" returned: 0 in 0.336s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Lock "cinder-quobyte-c7a7479a-3330-4f9d-89ed-919be3fa181b" released by "delete_volume" :: held 0.800s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Created reservations ['421af37d-6d9a-433c-b1da-b50615015a22', '10e2337e-8615-4b46-8c47-4b89fee81368', 'e807b30e-5adb-4502-9a70-b937bcb098e1', 'f4ec6fb9-21c3-4d98-8699-ccb54765ad8c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:30 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:50:30 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:30 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.363s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:50:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Deleted volume successfully. Sep 18 23:50:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa16c57e-15e4-40fd-ae2a-ef7107f47d04 tempest-VolumesTransfersTest-36957980 None] Lock "cinder-c7a7479a-3330-4f9d-89ed-919be3fa181b-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Flow 'volume_create_manager' (9616bbf0-89c2-4b03-a389-9cc80061a0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc454e13-9755-441a-a2ba-24b87ee6b47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc454e13-9755-441a-a2ba-24b87ee6b47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1678723258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa89aa07-0c69-4010-8afe-3f447463565f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecd8def8a944c3d94b18b91622ef78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:50:31Z,use_quota=True,user_id='dd2076e55eaf4dc0ac4d8ff5acd65989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa457df7-a816-47e9-a1bb-f78b8e8784ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa457df7-a816-47e9-a1bb-f78b8e8784ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce25469f-1e7e-4505-a2ca-acff33f69edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce25469f-1e7e-4505-a2ca-acff33f69edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa89aa07-0c69-4010-8afe-3f447463565f', 'volume_name': 'volume-fa89aa07-0c69-4010-8afe-3f447463565f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12e5977-bb1e-41ce-ba50-0018ddbbb896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12e5977-bb1e-41ce-ba50-0018ddbbb896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4195ae0-9610-4d97-9434-ff4d9ae1f5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:31 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Volume fa89aa07-0c69-4010-8afe-3f447463565f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa89aa07-0c69-4010-8afe-3f447463565f', 'volume_size': 1} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1678723258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa89aa07-0c69-4010-8afe-3f447463565f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecd8def8a944c3d94b18b91622ef78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:50:31Z,use_quota=True,user_id='dd2076e55eaf4dc0ac4d8ff5acd65989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Creating volume fa89aa07-0c69-4010-8afe-3f447463565f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:50:31 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa89aa07-0c69-4010-8afe-3f447463565f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:31 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa89aa07-0c69-4010-8afe-3f447463565f 1073741824 Sep 18 23:50:31 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Acquiring lock "cinder-quobyte-8b6efca9-4a32-4c43-9a4e-3fef95c7c930" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Lock "cinder-quobyte-8b6efca9-4a32-4c43-9a4e-3fef95c7c930" acquired by "delete_volume" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f67a3b-2a2b-42e2-80d9-77f95d227641]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:50:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:32 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 Sep 18 23:50:32 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:32 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa89aa07-0c69-4010-8afe-3f447463565f 1073741824" returned: 0 in 0.777s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa89aa07-0c69-4010-8afe-3f447463565f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:32 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa89aa07-0c69-4010-8afe-3f447463565f Sep 18 23:50:32 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:32 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930" returned: 0 in 0.806s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:32 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930 Sep 18 23:50:32 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:32 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa89aa07-0c69-4010-8afe-3f447463565f" returned: 0 in 0.490s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:50:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4195ae0-9610-4d97-9434-ff4d9ae1f5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa89aa07-0c69-4010-8afe-3f447463565f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b98cf9-35d7-4a4f-aac6-b29e53fd5970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:32 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Volume volume-fa89aa07-0c69-4010-8afe-3f447463565f (fa89aa07-0c69-4010-8afe-3f447463565f): created successfully Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b98cf9-35d7-4a4f-aac6-b29e53fd5970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Flow 'volume_create_manager' (9616bbf0-89c2-4b03-a389-9cc80061a0cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:50:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-479fff19-0580-4615-9995-e94798783d10 tempest-VolumesTransfersTest-1088616814 None] Created volume successfully. Sep 18 23:50:33 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8b6efca9-4a32-4c43-9a4e-3fef95c7c930" returned: 0 in 0.373s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Lock "cinder-quobyte-8b6efca9-4a32-4c43-9a4e-3fef95c7c930" released by "delete_volume" :: held 1.264s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Created reservations ['26d5a756-fff0-4bc4-a6bb-cd7af2f159d5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:50:33 devstack cinder-volume[85963]: WARNING cinder.quota [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-444568865 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-444568865, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Created reservations ['30b3b1c5-49bc-4323-b0ae-57bb8219fd3d', 'a4b1658c-e8f9-4e2d-9c67-c865aca7c3c8', 'dab6280c-4d28-4d92-bcf4-36da7530eee1', 'addf4e09-09e5-4ca2-9d0e-1e73043ff271'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:33 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:50:33 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:33 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.401s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:33 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:50:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2117d163-2e64-415b-99fb-96c1bd796373 tempest-GroupSnapshotsV319Test-1228957703 None] Delete group completed successfully. Sep 18 23:50:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Acquiring lock "cinder-fa89aa07-0c69-4010-8afe-3f447463565f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Lock "cinder-fa89aa07-0c69-4010-8afe-3f447463565f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Acquiring lock "cinder-quobyte-fa89aa07-0c69-4010-8afe-3f447463565f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Lock "cinder-quobyte-fa89aa07-0c69-4010-8afe-3f447463565f" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[89db4dce-889a-48d7-a1f0-86ac982b51e1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:50:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa89aa07-0c69-4010-8afe-3f447463565f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:34 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa89aa07-0c69-4010-8afe-3f447463565f Sep 18 23:50:34 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:34 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa89aa07-0c69-4010-8afe-3f447463565f" returned: 0 in 0.468s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa89aa07-0c69-4010-8afe-3f447463565f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:34 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa89aa07-0c69-4010-8afe-3f447463565f Sep 18 23:50:34 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:35 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa89aa07-0c69-4010-8afe-3f447463565f" returned: 0 in 0.308s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Lock "cinder-quobyte-fa89aa07-0c69-4010-8afe-3f447463565f" released by "delete_volume" :: held 0.840s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:35 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Created reservations ['51bf5f39-8249-4a4d-8bd2-484d3f9375f7', '19c5b686-a32d-4476-99ed-b0b3bf330d70', 'df0669ec-e5ee-42d3-bd1a-a8fe0ec9d6bf', '12597fa6-0c01-47b5-8972-f5fa521163bd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:50:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:50:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:50:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:35 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:50:35 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:35 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:35 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:50:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Deleted volume successfully. Sep 18 23:50:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30fb99d2-21c6-4c08-9131-2a78873ade53 tempest-VolumesTransfersTest-36957980 None] Lock "cinder-fa89aa07-0c69-4010-8afe-3f447463565f-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:45 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=45,cinder:SELECT=37,cinder:INSERT=13,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:50:45 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=39,cinder:UPDATE=45,cinder:DELETE=4,cinder:INSERT=8 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:50:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-647f33ab-c6ca-43ef-a31f-41929f922074 tempest-GroupsTest-897464604 None] Group tempest-Group1-534713160: creating Sep 18 23:50:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-647f33ab-c6ca-43ef-a31f-41929f922074 tempest-GroupsTest-897464604 None] Group tempest-Group1-534713160: created successfully Sep 18 23:50:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-647f33ab-c6ca-43ef-a31f-41929f922074 tempest-GroupsTest-897464604 None] Create group completed successfully. Sep 18 23:50:54 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6999dddb-e406-4a77-923a-a3c55404ad95 tempest-GroupsTest-897464604 None] Group tempest-Group2-718812192: creating Sep 18 23:50:54 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6999dddb-e406-4a77-923a-a3c55404ad95 tempest-GroupsTest-897464604 None] Group tempest-Group2-718812192: created successfully Sep 18 23:50:54 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6999dddb-e406-4a77-923a-a3c55404ad95 tempest-GroupsTest-897464604 None] Create group completed successfully. Sep 18 23:50:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-453c9b28-a303-468b-a30c-d95692a074a0 tempest-ServerActionsTestOtherA-2129144877 None] Terminate volume connection completed successfully. Sep 18 23:50:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-453c9b28-a303-468b-a30c-d95692a074a0 tempest-ServerActionsTestOtherA-2129144877 None] Deleting attachment 7eda35f8-a783-4a69-a438-cbafa41a9f7d. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:50:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "cinder-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Lock "cinder-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "cinder-quobyte-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Lock "cinder-quobyte-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5" acquired by "delete_volume" :: waited 0.047s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:56 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a090a8c-c702-411a-9031-db317080a85c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:50:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:56 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 Sep 18 23:50:56 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:57 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5" returned: 0 in 1.333s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:57 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5 Sep 18 23:50:57 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "cinder-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Lock "cinder-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:57 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:50:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Flow 'volume_create_manager' (0f44c526-4831-4e56-a863-c5fa5ee8e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:50:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce34819-adb5-44db-a378-59d97f34e617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce34819-adb5-44db-a378-59d97f34e617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1429470660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77c198ba-3f3d-4bd4-9d02-b75dc014e9af,host='devstack@QuobyteHD#QuobyteHD',id=ba75ed99-96df-471e-b490-b1df1ac9172c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e3036b531d42a8b2af6b37a7a7eb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:50:58Z,use_quota=True,user_id='3f4403655e634bf09537baf51fc509c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(618cd4c2-6c25-4ecc-a5ba-d43f87d94447),volume_type_id=618cd4c2-6c25-4ecc-a5ba-d43f87d94447)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c69ffec-90f4-4a99-9d04-a4988ea7c88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c69ffec-90f4-4a99-9d04-a4988ea7c88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cdcf5c-ae46-4885-949d-8ebdfc284f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cdcf5c-ae46-4885-949d-8ebdfc284f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba75ed99-96df-471e-b490-b1df1ac9172c', 'volume_name': 'volume-ba75ed99-96df-471e-b490-b1df1ac9172c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef2ec77-bf94-454a-b74a-2c171c40166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef2ec77-bf94-454a-b74a-2c171c40166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c60d36-bfb7-45f9-a98c-2702808c7aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Volume ba75ed99-96df-471e-b490-b1df1ac9172c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba75ed99-96df-471e-b490-b1df1ac9172c', 'volume_size': 1} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=77c198ba-3f3d-4bd4-9d02-b75dc014e9af,created_at=2026-09-18T21:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1429470660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77c198ba-3f3d-4bd4-9d02-b75dc014e9af,host='devstack@QuobyteHD#QuobyteHD',id=ba75ed99-96df-471e-b490-b1df1ac9172c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e3036b531d42a8b2af6b37a7a7eb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:50:58Z,use_quota=True,user_id='3f4403655e634bf09537baf51fc509c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(618cd4c2-6c25-4ecc-a5ba-d43f87d94447),volume_type_id=618cd4c2-6c25-4ecc-a5ba-d43f87d94447)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Creating volume ba75ed99-96df-471e-b490-b1df1ac9172c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:50:58 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ba75ed99-96df-471e-b490-b1df1ac9172c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:58 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ba75ed99-96df-471e-b490-b1df1ac9172c 1073741824 Sep 18 23:50:58 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "cinder-quobyte-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:50:58 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5" returned: 0 in 0.822s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Lock "cinder-quobyte-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5" released by "delete_volume" :: held 2.266s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Lock "cinder-quobyte-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd" acquired by "delete_volume" :: waited 0.055s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ba1646-269f-462f-8efb-02ac90b23fb2]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.quota [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Created reservations ['b3e84582-f135-4762-973c-c52c7f4e3c7f', 'dda5ea21-3e7b-4285-b767-0ca3c846724c', '591cf8a6-ac41-48a1-91ca-389c9db946bd', 'ae6e28f0-3ef5-488b-a815-2ec08f0767f5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:50:58 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd Sep 18 23:50:58 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:58 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:50:58 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:59 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ba75ed99-96df-471e-b490-b1df1ac9172c 1073741824" returned: 0 in 1.075s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:59 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd" returned: 0 in 0.916s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:59 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd Sep 18 23:50:59 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ba75ed99-96df-471e-b490-b1df1ac9172c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:59 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.601s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG cinder.manager [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:50:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Deleted volume successfully. Sep 18 23:50:59 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ba75ed99-96df-471e-b490-b1df1ac9172c Sep 18 23:50:59 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-82b32618-8b1b-4480-8906-64c40ca90a9c req-21686284-3fb7-4089-af96-6e735509f12c tempest-ServerActionsTestOtherA-2129144877 None] Lock "cinder-22cbdb82-1bcb-4c9e-a677-57b1bd2b6ec5-delete_volume" released by "delete_volume" :: held 3.607s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:59 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd" returned: 0 in 0.405s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Lock "cinder-quobyte-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd" released by "delete_volume" :: held 1.408s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:50:59 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ba75ed99-96df-471e-b490-b1df1ac9172c" returned: 0 in 0.422s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c60d36-bfb7-45f9-a98c-2702808c7aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba75ed99-96df-471e-b490-b1df1ac9172c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33089bac-02a7-4114-81ed-f2d3219c1ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Created reservations ['638814e3-8c15-454c-ab20-2fd11529b084', 'c7f9d812-9698-45cd-a78e-772e2d451419', '8f6c2698-308d-4251-9d74-6cd2b3e99423', '0fec528a-1de2-401d-8db7-bb16add7eee1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:50:59 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Volume volume-ba75ed99-96df-471e-b490-b1df1ac9172c (ba75ed99-96df-471e-b490-b1df1ac9172c): created successfully Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33089bac-02a7-4114-81ed-f2d3219c1ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Flow 'volume_create_manager' (0f44c526-4831-4e56-a863-c5fa5ee8e247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:50:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6006760c-bbc8-45b6-8550-6e9ba59494dc tempest-GroupsTest-897464604 None] Created volume successfully. Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:50:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:50:59 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:50:59 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:00 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.428s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:51:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Deleted volume successfully. Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2341b562-34cd-4e7f-a4ef-6ebea3d29709 tempest-ServerActionsTestOtherA-2129144877 None] Lock "cinder-39a35bc2-c1c4-40ea-af4e-950e82a3f6fd-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Flow 'volume_create_manager' (b5cc4c08-10bc-4cb5-8e90-87e949552bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d363db6-9a71-4770-a2ac-d655c46e878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d363db6-9a71-4770-a2ac-d655c46e878f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-900981356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f3f954-46af-45be-9fdf-7f9b12727c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f795dc3348df4f1da7333f7c2075906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:01Z,use_quota=True,user_id='fd6b553cbac145c8a9243a8b6503925c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f56cf2-bd5a-442b-b5f9-61b487b187f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f56cf2-bd5a-442b-b5f9-61b487b187f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29402a78-23f7-4afc-8abf-3adc13e3ce48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29402a78-23f7-4afc-8abf-3adc13e3ce48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f3f954-46af-45be-9fdf-7f9b12727c06', 'volume_name': 'volume-27f3f954-46af-45be-9fdf-7f9b12727c06', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec3754c-7c86-425e-b157-534ddb61f690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec3754c-7c86-425e-b157-534ddb61f690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb40079-18a4-47fc-9c87-5e27f7ed7d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Volume 27f3f954-46af-45be-9fdf-7f9b12727c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f3f954-46af-45be-9fdf-7f9b12727c06', 'volume_size': 1} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-900981356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f3f954-46af-45be-9fdf-7f9b12727c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f795dc3348df4f1da7333f7c2075906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:01Z,use_quota=True,user_id='fd6b553cbac145c8a9243a8b6503925c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Creating volume 27f3f954-46af-45be-9fdf-7f9b12727c06 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:51:00 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:51:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:00 devstack sudo[94166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 1073741824 Sep 18 23:51:00 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Acquiring lock "cinder-quobyte-ba75ed99-96df-471e-b490-b1df1ac9172c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Lock "cinder-quobyte-ba75ed99-96df-471e-b490-b1df1ac9172c" acquired by "delete_volume" :: waited 0.080s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc54b7b-ad5e-4257-89ff-a483837e264c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:51:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ba75ed99-96df-471e-b490-b1df1ac9172c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:01 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 1073741824" returned: 0 in 0.940s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:01 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ba75ed99-96df-471e-b490-b1df1ac9172c Sep 18 23:51:01 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:01 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 Sep 18 23:51:01 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:02 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ba75ed99-96df-471e-b490-b1df1ac9172c" returned: 0 in 0.414s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ba75ed99-96df-471e-b490-b1df1ac9172c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:02 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06" returned: 0 in 0.311s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:02 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ba75ed99-96df-471e-b490-b1df1ac9172c Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb40079-18a4-47fc-9c87-5e27f7ed7d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f3f954-46af-45be-9fdf-7f9b12727c06', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:02 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d26cf36-252d-4f92-86ff-d7e3cd7a2d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Volume volume-27f3f954-46af-45be-9fdf-7f9b12727c06 (27f3f954-46af-45be-9fdf-7f9b12727c06): created successfully Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d26cf36-252d-4f92-86ff-d7e3cd7a2d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Flow 'volume_create_manager' (b5cc4c08-10bc-4cb5-8e90-87e949552bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4e99159c-bc2f-4344-b69d-e9f1fb9fd784 tempest-VolumesActionsTest-1123081023 None] Created volume successfully. Sep 18 23:51:02 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ba75ed99-96df-471e-b490-b1df1ac9172c" returned: 0 in 0.318s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Lock "cinder-quobyte-ba75ed99-96df-471e-b490-b1df1ac9172c" released by "delete_volume" :: held 0.790s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Created reservations ['3558fd62-e93c-4bd8-ac00-05d7e8d0539b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:51:02 devstack cinder-volume[85963]: WARNING cinder.quota [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1748788443 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1748788443, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:51:02 devstack cinder-volume[85963]: WARNING cinder.quota [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1748788443 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1748788443, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Created reservations ['2ed4ece2-6074-49bc-9cb1-189e21c147fd', 'c1e26ca1-fb6a-4c5d-8a56-5be7ab035bc3', '492d181a-22ae-4351-b43c-7dd100b0dc17', '12c0523c-2bb2-4223-b902-f7654666ac5a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:02 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:51:02 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:03 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9820db86-b3d6-40a6-86b8-c687244b8ee3 tempest-GroupsTest-897464604 None] Created reservations ['d5107864-6ccc-4487-bc2f-4f3ea1da7639'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:51:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9820db86-b3d6-40a6-86b8-c687244b8ee3 tempest-GroupsTest-897464604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9820db86-b3d6-40a6-86b8-c687244b8ee3 tempest-GroupsTest-897464604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9820db86-b3d6-40a6-86b8-c687244b8ee3 tempest-GroupsTest-897464604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9820db86-b3d6-40a6-86b8-c687244b8ee3 tempest-GroupsTest-897464604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9820db86-b3d6-40a6-86b8-c687244b8ee3 tempest-GroupsTest-897464604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9820db86-b3d6-40a6-86b8-c687244b8ee3 tempest-GroupsTest-897464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:03 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.336s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:03 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:51:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4e836c78-82d6-4b63-a204-b2ed0b2e98c8 tempest-GroupsTest-897464604 None] Delete group completed successfully. Sep 18 23:51:03 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:51:03 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:03 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9820db86-b3d6-40a6-86b8-c687244b8ee3 tempest-GroupsTest-897464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.255s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:03 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-9820db86-b3d6-40a6-86b8-c687244b8ee3 tempest-GroupsTest-897464604 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:51:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9820db86-b3d6-40a6-86b8-c687244b8ee3 tempest-GroupsTest-897464604 None] Delete group completed successfully. Sep 18 23:51:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c93694a4-b85f-4886-aa44-a1a5b89d8990 tempest-GroupsTest-897464604 None] Group tempest-GroupsTest-Group-286874179: creating Sep 18 23:51:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c93694a4-b85f-4886-aa44-a1a5b89d8990 tempest-GroupsTest-897464604 None] Group tempest-GroupsTest-Group-286874179: created successfully Sep 18 23:51:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c93694a4-b85f-4886-aa44-a1a5b89d8990 tempest-GroupsTest-897464604 None] Create group completed successfully. Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Flow 'volume_create_manager' (7aaf9f6b-a584-4130-849a-d4f76195c772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e9fd19-a83a-4fc3-870a-f130a6b6ae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e9fd19-a83a-4fc3-870a-f130a6b6ae20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1684944557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64cbeb78-2015-49b3-9b1a-170c409c0263,host='devstack@QuobyteHD#QuobyteHD',id=21b0fd71-d344-4f6d-84d2-7922ed64bfb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e3036b531d42a8b2af6b37a7a7eb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:06Z,use_quota=True,user_id='3f4403655e634bf09537baf51fc509c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d32c540e-7220-49fe-9830-1533c11cb99c),volume_type_id=d32c540e-7220-49fe-9830-1533c11cb99c)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1d61c2-2ab4-41b2-9dad-8baea9ca7eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1d61c2-2ab4-41b2-9dad-8baea9ca7eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590ad54e-b517-4aa3-aef0-3dd3947e569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590ad54e-b517-4aa3-aef0-3dd3947e569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b0fd71-d344-4f6d-84d2-7922ed64bfb3', 'volume_name': 'volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d06182-e453-438c-be3d-ef5111742a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d06182-e453-438c-be3d-ef5111742a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8e8682-7a76-4b01-963e-daadc54895f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:06 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Volume 21b0fd71-d344-4f6d-84d2-7922ed64bfb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3', 'volume_size': 1} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=64cbeb78-2015-49b3-9b1a-170c409c0263,created_at=2026-09-18T21:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1684944557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64cbeb78-2015-49b3-9b1a-170c409c0263,host='devstack@QuobyteHD#QuobyteHD',id=21b0fd71-d344-4f6d-84d2-7922ed64bfb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e3036b531d42a8b2af6b37a7a7eb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:06Z,use_quota=True,user_id='3f4403655e634bf09537baf51fc509c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d32c540e-7220-49fe-9830-1533c11cb99c),volume_type_id=d32c540e-7220-49fe-9830-1533c11cb99c)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Creating volume 21b0fd71-d344-4f6d-84d2-7922ed64bfb3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:51:06 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:51:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:06 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3 1073741824 Sep 18 23:51:06 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:07 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3 1073741824" returned: 0 in 0.539s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:07 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3 Sep 18 23:51:07 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:07 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:51:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8e8682-7a76-4b01-963e-daadc54895f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4be8f4-c631-49d5-9af9-e3549484f038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:07 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Volume volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3 (21b0fd71-d344-4f6d-84d2-7922ed64bfb3): created successfully Sep 18 23:51:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4be8f4-c631-49d5-9af9-e3549484f038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Flow 'volume_create_manager' (7aaf9f6b-a584-4130-849a-d4f76195c772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3d808657-454b-4461-bbd9-f58ee842121e tempest-GroupsTest-897464604 None] Created volume successfully. Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Flow 'volume_create_manager' (0acb4105-3736-4739-b8f7-d2740526ef6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42de31d4-c4c2-42ae-bae1-b2d1567f407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42de31d4-c4c2-42ae-bae1-b2d1567f407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1353117102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64cbeb78-2015-49b3-9b1a-170c409c0263,host='devstack@QuobyteHD#QuobyteHD',id=fa6b8f48-1e34-4730-9306-93defd5c9ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e3036b531d42a8b2af6b37a7a7eb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:09Z,use_quota=True,user_id='3f4403655e634bf09537baf51fc509c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d32c540e-7220-49fe-9830-1533c11cb99c),volume_type_id=d32c540e-7220-49fe-9830-1533c11cb99c)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a272d8a5-e1b4-4e51-bc96-6eaa7bc771b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a272d8a5-e1b4-4e51-bc96-6eaa7bc771b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313d43d9-9ed4-4982-b30a-e382e3b80a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313d43d9-9ed4-4982-b30a-e382e3b80a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6b8f48-1e34-4730-9306-93defd5c9ab3', 'volume_name': 'volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91abb71-efff-4aab-8738-39b035f42336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91abb71-efff-4aab-8738-39b035f42336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b922b49-2ce6-4579-a80f-a360a0f8aa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:09 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Volume fa6b8f48-1e34-4730-9306-93defd5c9ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3', 'volume_size': 1} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=64cbeb78-2015-49b3-9b1a-170c409c0263,created_at=2026-09-18T21:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1353117102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=64cbeb78-2015-49b3-9b1a-170c409c0263,host='devstack@QuobyteHD#QuobyteHD',id=fa6b8f48-1e34-4730-9306-93defd5c9ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e3036b531d42a8b2af6b37a7a7eb9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:09Z,use_quota=True,user_id='3f4403655e634bf09537baf51fc509c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d32c540e-7220-49fe-9830-1533c11cb99c),volume_type_id=d32c540e-7220-49fe-9830-1533c11cb99c)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Creating volume fa6b8f48-1e34-4730-9306-93defd5c9ab3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:51:09 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:51:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:09 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3 1073741824 Sep 18 23:51:09 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:10 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3 1073741824" returned: 0 in 0.970s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:10 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3 Sep 18 23:51:10 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:10 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3" returned: 0 in 0.374s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:51:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b922b49-2ce6-4579-a80f-a360a0f8aa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f35a02-e1e4-43c3-a2ad-6037da591597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Volume volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3 (fa6b8f48-1e34-4730-9306-93defd5c9ab3): created successfully Sep 18 23:51:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f35a02-e1e4-43c3-a2ad-6037da591597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Flow 'volume_create_manager' (0acb4105-3736-4739-b8f7-d2740526ef6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3076478a-c5ef-4d8c-9521-592c4bd99563 tempest-GroupsTest-897464604 None] Created volume successfully. Sep 18 23:51:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9fdf3761-f9c5-4200-b639-0f73012d1c13 tempest-GroupsTest-897464604 None] Update group completed successfully. Sep 18 23:51:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-107f5f29-d164-4d82-b080-376517dc9b1a tempest-VolumesActionsTest-1123081023 None] Acquiring lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06" by "attach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-107f5f29-d164-4d82-b080-376517dc9b1a tempest-VolumesActionsTest-1123081023 None] Lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06" acquired by "attach_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-107f5f29-d164-4d82-b080-376517dc9b1a tempest-VolumesActionsTest-1123081023 None] Attaching volume 27f3f954-46af-45be-9fdf-7f9b12727c06 to instance 4262b52d-5140-4226-a2f8-684fcbfa9447 at mountpoint /dev/vdb on host None. Sep 18 23:51:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-107f5f29-d164-4d82-b080-376517dc9b1a tempest-VolumesActionsTest-1123081023 None] Attach volume completed successfully. Sep 18 23:51:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-107f5f29-d164-4d82-b080-376517dc9b1a tempest-VolumesActionsTest-1123081023 None] Lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06" released by "attach_volume" :: held 0.142s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45e52613-d47a-47ee-a5e6-ef9f5a598a70 tempest-VolumesActionsTest-1123081023 None] Acquiring lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06-detach_volume" by "detach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45e52613-d47a-47ee-a5e6-ef9f5a598a70 tempest-VolumesActionsTest-1123081023 None] Lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-45e52613-d47a-47ee-a5e6-ef9f5a598a70 tempest-VolumesActionsTest-1123081023 None] Detaching volume 27f3f954-46af-45be-9fdf-7f9b12727c06 from instance 4262b52d-5140-4226-a2f8-684fcbfa9447. Sep 18 23:51:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-45e52613-d47a-47ee-a5e6-ef9f5a598a70 tempest-VolumesActionsTest-1123081023 None] Detach volume completed successfully. Sep 18 23:51:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45e52613-d47a-47ee-a5e6-ef9f5a598a70 tempest-VolumesActionsTest-1123081023 None] Lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-95a5148d-62b3-49ce-9378-c5748b833158 tempest-GroupsTest-897464604 None] Update group completed successfully. Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Flow 'volume_create_manager' (c5399dad-b283-4734-a2e5-4fc9227841e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6d8ebd-2dea-4bab-aa1c-375bb801327d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6d8ebd-2dea-4bab-aa1c-375bb801327d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-388079944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af9450e-495c-4997-a49b-a931d0d22aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd497021e35403b8c419e014a418c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:14Z,use_quota=True,user_id='9479ce5868cb402697d9b72545a0fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd79429e-407e-457e-834f-81e0aa5df65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd79429e-407e-457e-834f-81e0aa5df65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2678f1-2b24-4492-bd40-608f30e9bf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2678f1-2b24-4492-bd40-608f30e9bf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7af9450e-495c-4997-a49b-a931d0d22aaa', 'volume_name': 'volume-7af9450e-495c-4997-a49b-a931d0d22aaa', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f21e23b-95a9-4585-b49f-1e6030a9411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f21e23b-95a9-4585-b49f-1e6030a9411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad570c8e-3969-46d6-95af-52d6ce3c8fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Volume 7af9450e-495c-4997-a49b-a931d0d22aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7af9450e-495c-4997-a49b-a931d0d22aaa', 'volume_size': 1} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-388079944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af9450e-495c-4997-a49b-a931d0d22aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd497021e35403b8c419e014a418c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:14Z,use_quota=True,user_id='9479ce5868cb402697d9b72545a0fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Creating volume 7af9450e-495c-4997-a49b-a931d0d22aaa {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:51:14 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-7af9450e-495c-4997-a49b-a931d0d22aaa 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:14 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-7af9450e-495c-4997-a49b-a931d0d22aaa 1073741824 Sep 18 23:51:14 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:14 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-7af9450e-495c-4997-a49b-a931d0d22aaa 1073741824" returned: 0 in 0.615s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-7af9450e-495c-4997-a49b-a931d0d22aaa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:14 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-7af9450e-495c-4997-a49b-a931d0d22aaa Sep 18 23:51:14 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:15 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-7af9450e-495c-4997-a49b-a931d0d22aaa" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad570c8e-3969-46d6-95af-52d6ce3c8fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af9450e-495c-4997-a49b-a931d0d22aaa', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2e7d46-2eba-4be6-a724-e06e7124b8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:15 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Volume volume-7af9450e-495c-4997-a49b-a931d0d22aaa (7af9450e-495c-4997-a49b-a931d0d22aaa): created successfully Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2e7d46-2eba-4be6-a724-e06e7124b8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Flow 'volume_create_manager' (c5399dad-b283-4734-a2e5-4fc9227841e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0d4a1799-de9e-43c1-8306-408ed175e065 tempest-AttachVolumeTestJSON-268412481 None] Created volume successfully. Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Acquiring lock "cinder-quobyte-21b0fd71-d344-4f6d-84d2-7922ed64bfb3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Lock "cinder-quobyte-21b0fd71-d344-4f6d-84d2-7922ed64bfb3" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad397b8e-77c2-45d0-8e8e-df6f149fc544]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:15 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3 Sep 18 23:51:15 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:15 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3" returned: 0 in 0.456s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:15 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3 Sep 18 23:51:15 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:16 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-21b0fd71-d344-4f6d-84d2-7922ed64bfb3" returned: 0 in 0.334s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Lock "cinder-quobyte-21b0fd71-d344-4f6d-84d2-7922ed64bfb3" released by "delete_volume" :: held 0.847s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Acquiring lock "cinder-quobyte-fa6b8f48-1e34-4730-9306-93defd5c9ab3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Lock "cinder-quobyte-fa6b8f48-1e34-4730-9306-93defd5c9ab3" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[908a9e64-6301-485c-84e8-b3290bb7219c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:51:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:16 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3 Sep 18 23:51:16 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:16 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3" returned: 0 in 0.490s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:16 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3 Sep 18 23:51:16 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:17 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fa6b8f48-1e34-4730-9306-93defd5c9ab3" returned: 0 in 0.416s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Lock "cinder-quobyte-fa6b8f48-1e34-4730-9306-93defd5c9ab3" released by "delete_volume" :: held 0.950s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-a0fb469a-8a4d-4d38-abfa-2adddab5a7fd req-247f4c8a-817c-4c1b-8ebe-0d3070949f71 tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-a0fb469a-8a4d-4d38-abfa-2adddab5a7fd req-247f4c8a-817c-4c1b-8ebe-0d3070949f71 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-a0fb469a-8a4d-4d38-abfa-2adddab5a7fd req-247f4c8a-817c-4c1b-8ebe-0d3070949f71 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Created reservations ['67643deb-b1ac-40d7-bf43-31b963520244'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:51:17 devstack cinder-volume[85963]: WARNING cinder.quota [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-377947678 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-377947678, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:51:17 devstack cinder-volume[85963]: WARNING cinder.quota [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-377947678 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-377947678, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-a0fb469a-8a4d-4d38-abfa-2adddab5a7fd req-247f4c8a-817c-4c1b-8ebe-0d3070949f71 tempest-AttachVolumeTestJSON-268412481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-7af9450e-495c-4997-a49b-a931d0d22aaa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b598837-395a-4271-a51a-22a52e3121c8', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Created reservations ['f94a4b5b-15dd-491b-a173-b613a2c4b04c', '6a06586d-af8f-4bfa-8057-46fc5b6051bb', '56cc4723-343d-4ff6-a668-97f16e9f317d', 'f013c34c-51fe-41b5-8298-2e710a21c2ff'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:51:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-a0fb469a-8a4d-4d38-abfa-2adddab5a7fd req-247f4c8a-817c-4c1b-8ebe-0d3070949f71 tempest-AttachVolumeTestJSON-268412481 None] attachment_update completed successfully. Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Created reservations ['84260ad6-d82d-427e-9048-ff816c31b06a', 'ceef1452-5110-4b54-8134-cbe8d7d8a221', 'f2897994-9bac-4f0f-8dff-e90f4f6f2ed7', '59b588c2-c28a-40f7-87e3-6d2be71ef632'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Flow 'volume_create_manager' (205d28e1-105f-4a5b-9e2d-9517be1f731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e54cb33-9b23-4bc9-997c-06bde6a00016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e54cb33-9b23-4bc9-997c-06bde6a00016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1568360257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc389bdb-5e69-49b3-a53b-54896b90859c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f715d9fbd25f4fd8841d9df908666fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:18Z,use_quota=True,user_id='8d4c962ad7c24904a8999c3761069abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5a249d-b7e8-4cf1-939f-8a1ab6fb5a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5a249d-b7e8-4cf1-939f-8a1ab6fb5a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb00b0a-1305-4653-bdd7-1d6a8f962fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb00b0a-1305-4653-bdd7-1d6a8f962fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc389bdb-5e69-49b3-a53b-54896b90859c', 'volume_name': 'volume-cc389bdb-5e69-49b3-a53b-54896b90859c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5c6ab4-ef38-46b8-822e-858d85d80241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5c6ab4-ef38-46b8-822e-858d85d80241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7377acd-1e01-47cf-a7a2-43ef5cf1bcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:17 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Volume cc389bdb-5e69-49b3-a53b-54896b90859c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc389bdb-5e69-49b3-a53b-54896b90859c', 'volume_size': 1} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1568360257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc389bdb-5e69-49b3-a53b-54896b90859c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f715d9fbd25f4fd8841d9df908666fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:18Z,use_quota=True,user_id='8d4c962ad7c24904a8999c3761069abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Creating volume cc389bdb-5e69-49b3-a53b-54896b90859c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:51:17 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cc389bdb-5e69-49b3-a53b-54896b90859c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:17 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cc389bdb-5e69-49b3-a53b-54896b90859c 1073741824 Sep 18 23:51:17 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:17 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:51:17 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:18 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.508s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:18 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:51:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-675e9ff9-09a3-4041-b5a0-f6c295a38b47 tempest-GroupsTest-897464604 None] Delete group completed successfully. Sep 18 23:51:18 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cc389bdb-5e69-49b3-a53b-54896b90859c 1073741824" returned: 0 in 0.893s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cc389bdb-5e69-49b3-a53b-54896b90859c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:18 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cc389bdb-5e69-49b3-a53b-54896b90859c Sep 18 23:51:18 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:19 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cc389bdb-5e69-49b3-a53b-54896b90859c" returned: 0 in 0.309s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:51:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7377acd-1e01-47cf-a7a2-43ef5cf1bcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc389bdb-5e69-49b3-a53b-54896b90859c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681edb7a-2f50-4094-a45b-7f39711e98eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Volume volume-cc389bdb-5e69-49b3-a53b-54896b90859c (cc389bdb-5e69-49b3-a53b-54896b90859c): created successfully Sep 18 23:51:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681edb7a-2f50-4094-a45b-7f39711e98eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Flow 'volume_create_manager' (205d28e1-105f-4a5b-9e2d-9517be1f731d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-d1bb5c6c-0fa8-4fdd-a08e-51a188d6b330 req-53bb4069-dee0-49a5-b4f9-0c9274d48c5e tempest-VolumesGetTestJSON-1820977514 None] Created volume successfully. Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Flow 'volume_create_manager' (335a4471-84b9-481d-b8f7-09ce06b2e91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f67383-7007-4e1e-8d2b-8ae9a08cdaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f67383-7007-4e1e-8d2b-8ae9a08cdaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1588167739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7357151-cb1d-41cc-8c6a-276421ab7089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd497021e35403b8c419e014a418c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:20Z,use_quota=True,user_id='9479ce5868cb402697d9b72545a0fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7eb383-c2a6-4364-973a-42323bb35095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7eb383-c2a6-4364-973a-42323bb35095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6053d5c4-44c2-48ec-a8a4-edfa35a979a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6053d5c4-44c2-48ec-a8a4-edfa35a979a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7357151-cb1d-41cc-8c6a-276421ab7089', 'volume_name': 'volume-d7357151-cb1d-41cc-8c6a-276421ab7089', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa822909-cae9-4a82-a6a1-521958985709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa822909-cae9-4a82-a6a1-521958985709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26746b00-15de-4db7-b952-a377805de1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Volume d7357151-cb1d-41cc-8c6a-276421ab7089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7357151-cb1d-41cc-8c6a-276421ab7089', 'volume_size': 1} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1588167739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7357151-cb1d-41cc-8c6a-276421ab7089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd497021e35403b8c419e014a418c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:20Z,use_quota=True,user_id='9479ce5868cb402697d9b72545a0fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Creating volume d7357151-cb1d-41cc-8c6a-276421ab7089 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:51:20 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7357151-cb1d-41cc-8c6a-276421ab7089 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:20 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7357151-cb1d-41cc-8c6a-276421ab7089 1073741824 Sep 18 23:51:20 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Acquiring lock "cinder-cc389bdb-5e69-49b3-a53b-54896b90859c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Lock "cinder-cc389bdb-5e69-49b3-a53b-54896b90859c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Acquiring lock "cinder-quobyte-cc389bdb-5e69-49b3-a53b-54896b90859c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Lock "cinder-quobyte-cc389bdb-5e69-49b3-a53b-54896b90859c" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca63958-22e9-48bc-8121-ab9ce5673032]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:51:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cc389bdb-5e69-49b3-a53b-54896b90859c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:20 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cc389bdb-5e69-49b3-a53b-54896b90859c Sep 18 23:51:20 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:21 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7357151-cb1d-41cc-8c6a-276421ab7089 1073741824" returned: 0 in 0.607s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7357151-cb1d-41cc-8c6a-276421ab7089 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:21 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7357151-cb1d-41cc-8c6a-276421ab7089 Sep 18 23:51:21 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:21 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cc389bdb-5e69-49b3-a53b-54896b90859c" returned: 0 in 0.500s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cc389bdb-5e69-49b3-a53b-54896b90859c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:21 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cc389bdb-5e69-49b3-a53b-54896b90859c Sep 18 23:51:21 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:21 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:51:21 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:21 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7357151-cb1d-41cc-8c6a-276421ab7089" returned: 0 in 0.381s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26746b00-15de-4db7-b952-a377805de1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7357151-cb1d-41cc-8c6a-276421ab7089', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ece4092-7cd6-4469-948b-eb9440b1935b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:21 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cc389bdb-5e69-49b3-a53b-54896b90859c" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Volume volume-d7357151-cb1d-41cc-8c6a-276421ab7089 (d7357151-cb1d-41cc-8c6a-276421ab7089): created successfully Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ece4092-7cd6-4469-948b-eb9440b1935b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Flow 'volume_create_manager' (335a4471-84b9-481d-b8f7-09ce06b2e91d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Lock "cinder-quobyte-cc389bdb-5e69-49b3-a53b-54896b90859c" released by "delete_volume" :: held 0.966s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5e90203d-612c-4b99-9482-bc9e71c469ed tempest-AttachVolumeTestJSON-268412481 None] Created volume successfully. Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.quota [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Created reservations ['17eb795a-b0d0-44a2-8c99-c234268daa47', 'cc34b63a-2c47-4583-b41d-cea1881d1ba8', '0bd77661-e70a-465a-8c94-3fd91ea55dd6', '6ca7fc2f-8a64-465b-86ee-24752660804b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:51:21 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.439s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:21 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:51:21 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:22 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.421s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:22 devstack cinder-volume[85963]: DEBUG cinder.manager [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:51:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Deleted volume successfully. Sep 18 23:51:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-11b2ca16-b890-4cd0-81bc-d893303f1e26 req-906f4b4c-76ed-4f0b-8bf2-054e8b8f9148 tempest-VolumesGetTestJSON-1820977514 None] Lock "cinder-cc389bdb-5e69-49b3-a53b-54896b90859c-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-45bbf407-fabd-4034-9ef7-d22377ea35a5 req-9b9f1aad-60d1-4da2-aae6-3c2b635bb128 tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-45bbf407-fabd-4034-9ef7-d22377ea35a5 req-9b9f1aad-60d1-4da2-aae6-3c2b635bb128 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-45bbf407-fabd-4034-9ef7-d22377ea35a5 req-9b9f1aad-60d1-4da2-aae6-3c2b635bb128 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-45bbf407-fabd-4034-9ef7-d22377ea35a5 req-9b9f1aad-60d1-4da2-aae6-3c2b635bb128 tempest-AttachVolumeTestJSON-268412481 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-d7357151-cb1d-41cc-8c6a-276421ab7089', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f05f327b-c52d-4f2a-83c8-db1de840a4ad', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:51:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-45bbf407-fabd-4034-9ef7-d22377ea35a5 req-9b9f1aad-60d1-4da2-aae6-3c2b635bb128 tempest-AttachVolumeTestJSON-268412481 None] attachment_update completed successfully. Sep 18 23:51:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-294e697b-e76e-4c14-90bc-204c579882b4 tempest-VolumesActionsTest-1123081023 None] Acquiring lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06" by "attach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-294e697b-e76e-4c14-90bc-204c579882b4 tempest-VolumesActionsTest-1123081023 None] Lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06" acquired by "attach_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-294e697b-e76e-4c14-90bc-204c579882b4 tempest-VolumesActionsTest-1123081023 None] Attaching volume 27f3f954-46af-45be-9fdf-7f9b12727c06 to instance 19d96888-e193-46f3-8e82-326c08a552cc at mountpoint /dev/vdb on host None. Sep 18 23:51:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-294e697b-e76e-4c14-90bc-204c579882b4 tempest-VolumesActionsTest-1123081023 None] Attach volume completed successfully. Sep 18 23:51:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-294e697b-e76e-4c14-90bc-204c579882b4 tempest-VolumesActionsTest-1123081023 None] Lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06" released by "attach_volume" :: held 0.149s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ed230d7f-3111-428c-81c7-3a301398ed9b tempest-VolumesActionsTest-1123081023 None] Acquiring lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06-detach_volume" by "detach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-741a0cc4-8877-473a-8d4e-b033d00997ab req-9fcb7474-a1f7-4ddd-89ec-fc18b6b6f84b tempest-AttachVolumeTestJSON-268412481 None] Terminate volume connection completed successfully. Sep 18 23:51:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-741a0cc4-8877-473a-8d4e-b033d00997ab req-9fcb7474-a1f7-4ddd-89ec-fc18b6b6f84b tempest-AttachVolumeTestJSON-268412481 None] Deleting attachment 4b598837-395a-4271-a51a-22a52e3121c8. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:51:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ed230d7f-3111-428c-81c7-3a301398ed9b tempest-VolumesActionsTest-1123081023 None] Lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ed230d7f-3111-428c-81c7-3a301398ed9b tempest-VolumesActionsTest-1123081023 None] Detaching volume 27f3f954-46af-45be-9fdf-7f9b12727c06 from instance 19d96888-e193-46f3-8e82-326c08a552cc. Sep 18 23:51:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ed230d7f-3111-428c-81c7-3a301398ed9b tempest-VolumesActionsTest-1123081023 None] Detach volume completed successfully. Sep 18 23:51:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ed230d7f-3111-428c-81c7-3a301398ed9b tempest-VolumesActionsTest-1123081023 None] Lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-fa31ba51-b51f-4d9a-a135-02d94c0b4f83 req-4cc4d4f7-196c-49a4-9419-1056a6824a35 tempest-AttachVolumeTestJSON-268412481 None] Terminate volume connection completed successfully. Sep 18 23:51:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-fa31ba51-b51f-4d9a-a135-02d94c0b4f83 req-4cc4d4f7-196c-49a4-9419-1056a6824a35 tempest-AttachVolumeTestJSON-268412481 None] Deleting attachment f05f327b-c52d-4f2a-83c8-db1de840a4ad. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:51:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2ee8eee5-7ea2-4258-a144-2404d111bf12 tempest-GroupsV314Test-1596703490 None] Group tempest-GroupsV314Test-Group-570655902: creating Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Flow 'volume_create_manager' (00a887e9-16fd-4c00-aee3-ac656c1141bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243afa8e-692f-4a70-978b-42e9134f43be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243afa8e-692f-4a70-978b-42e9134f43be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1813756840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980018a1-3b76-4664-b78a-8c4b1bb7dd18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec1ecaa9cefb4b12abbad23f84dc6ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:30Z,use_quota=True,user_id='5e6b3dc681e54cbb8bd319ff46c933c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2e66d0-e048-43a0-9c76-5a63c958a7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2e66d0-e048-43a0-9c76-5a63c958a7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569c12d7-f8b0-4a43-8fd2-3e2a44bb1b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569c12d7-f8b0-4a43-8fd2-3e2a44bb1b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '980018a1-3b76-4664-b78a-8c4b1bb7dd18', 'volume_name': 'volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb63ac87-0d74-406a-800b-5364e77430c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb63ac87-0d74-406a-800b-5364e77430c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2421f8e-3cec-473a-809c-9555c8e171c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:30 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Volume 980018a1-3b76-4664-b78a-8c4b1bb7dd18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18', 'volume_size': 1} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1813756840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980018a1-3b76-4664-b78a-8c4b1bb7dd18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec1ecaa9cefb4b12abbad23f84dc6ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:30Z,use_quota=True,user_id='5e6b3dc681e54cbb8bd319ff46c933c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Creating volume 980018a1-3b76-4664-b78a-8c4b1bb7dd18 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:51:30 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2ee8eee5-7ea2-4258-a144-2404d111bf12 tempest-GroupsV314Test-1596703490 None] Group tempest-GroupsV314Test-Group-570655902: created successfully Sep 18 23:51:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2ee8eee5-7ea2-4258-a144-2404d111bf12 tempest-GroupsV314Test-1596703490 None] Create group completed successfully. Sep 18 23:51:30 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18 1073741824 Sep 18 23:51:30 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:30 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18 1073741824" returned: 0 in 0.523s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:30 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18 Sep 18 23:51:30 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:31 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18" returned: 0 in 0.542s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:51:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2421f8e-3cec-473a-809c-9555c8e171c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18cb178-7884-4000-85ce-73e3f1d29f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:31 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Volume volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18 (980018a1-3b76-4664-b78a-8c4b1bb7dd18): created successfully Sep 18 23:51:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18cb178-7884-4000-85ce-73e3f1d29f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Flow 'volume_create_manager' (00a887e9-16fd-4c00-aee3-ac656c1141bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e52b0f03-ea0a-4132-b0c8-a58144061ca4 tempest-VolumesTestJSON-1982083495 None] Created volume successfully. Sep 18 23:51:31 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Flow 'volume_create_manager' (f775b3b9-759a-4e52-9d78-27e85d629ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257db256-7c15-44a3-b50f-69d16a6d6771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257db256-7c15-44a3-b50f-69d16a6d6771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1853131682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8024f6b7-f855-4d0b-8303-5bad6f343209,host='devstack@QuobyteHD#QuobyteHD',id=092ae47b-c1b5-4853-b87e-39eb2b5c5821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5091ce56104c0f91ba8d64e0a7148c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:32Z,use_quota=True,user_id='9a055b25b8b347588a09602a0af9c345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20c99243-b343-497e-a5a1-f5d6ba750e82),volume_type_id=20c99243-b343-497e-a5a1-f5d6ba750e82)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e82c15d-3680-48c6-9848-5ef2a1246313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e82c15d-3680-48c6-9848-5ef2a1246313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e136f9-f8e8-4d6d-8766-ec0758055f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e136f9-f8e8-4d6d-8766-ec0758055f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '092ae47b-c1b5-4853-b87e-39eb2b5c5821', 'volume_name': 'volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84b566d-0652-4300-87ea-a1fe5fa7bbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84b566d-0652-4300-87ea-a1fe5fa7bbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f58bbe-e48d-4e89-8c8a-8c8706b705a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:32 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Volume 092ae47b-c1b5-4853-b87e-39eb2b5c5821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821', 'volume_size': 1} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8024f6b7-f855-4d0b-8303-5bad6f343209,created_at=2026-09-18T21:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1853131682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8024f6b7-f855-4d0b-8303-5bad6f343209,host='devstack@QuobyteHD#QuobyteHD',id=092ae47b-c1b5-4853-b87e-39eb2b5c5821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5091ce56104c0f91ba8d64e0a7148c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:32Z,use_quota=True,user_id='9a055b25b8b347588a09602a0af9c345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20c99243-b343-497e-a5a1-f5d6ba750e82),volume_type_id=20c99243-b343-497e-a5a1-f5d6ba750e82)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Creating volume 092ae47b-c1b5-4853-b87e-39eb2b5c5821 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:51:32 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:32 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 1073741824 Sep 18 23:51:32 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:32 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 1073741824" returned: 0 in 0.718s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:32 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 Sep 18 23:51:32 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Flow 'volume_create_manager' (72f7cc53-2383-48e5-ab13-46af5df08c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512261d3-2a88-4124-8054-3705535bc0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512261d3-2a88-4124-8054-3705535bc0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-411930423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffd2b6f-f90f-4ea9-aded-00c410822adb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec1ecaa9cefb4b12abbad23f84dc6ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:33Z,use_quota=True,user_id='5e6b3dc681e54cbb8bd319ff46c933c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020066c4-61f0-431a-adc4-d34171494d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020066c4-61f0-431a-adc4-d34171494d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7976be-ab83-4236-8893-ae00c5b4d6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7976be-ab83-4236-8893-ae00c5b4d6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ffd2b6f-f90f-4ea9-aded-00c410822adb', 'volume_name': 'volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2515c1ec-0b17-4024-9ee4-fce61143789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2515c1ec-0b17-4024-9ee4-fce61143789c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8063b87-579a-4475-bc4b-56c136ab63fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:33 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Volume 9ffd2b6f-f90f-4ea9-aded-00c410822adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb', 'volume_size': 1} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:33 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821" returned: 0 in 0.302s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.313s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f58bbe-e48d-4e89-8c8a-8c8706b705a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd10c97-2c51-418e-8b7a-099f20eb7482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a1952e-4549-498d-a5da-9a5805d528e8]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:33 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Volume volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 (092ae47b-c1b5-4853-b87e-39eb2b5c5821): created successfully Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd10c97-2c51-418e-8b7a-099f20eb7482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Flow 'volume_create_manager' (f775b3b9-759a-4e52-9d78-27e85d629ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2c9e9f29-13bb-48ef-a7af-8f03d55404b1 tempest-GroupsV314Test-1596703490 None] Created volume successfully. Sep 18 23:51:33 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 Sep 18 23:51:33 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:33 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06" returned: 0 in 0.406s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee46747-61d0-42ee-a810-440eb39bb685]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:51:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:33 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 Sep 18 23:51:33 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:34 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06" returned: 0 in 0.392s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.9b9fcc7d-3fbb-4b3b-939e-09626f61ef141m8hfq0t.img {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:34 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.9b9fcc7d-3fbb-4b3b-939e-09626f61ef141m8hfq0t.img Sep 18 23:51:34 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "cinder-d7357151-cb1d-41cc-8c6a-276421ab7089-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Lock "cinder-d7357151-cb1d-41cc-8c6a-276421ab7089-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "cinder-quobyte-d7357151-cb1d-41cc-8c6a-276421ab7089" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Lock "cinder-quobyte-d7357151-cb1d-41cc-8c6a-276421ab7089" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a58cc14-b541-4114-842a-f1dc9e6b6e56]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:51:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7357151-cb1d-41cc-8c6a-276421ab7089 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:34 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7357151-cb1d-41cc-8c6a-276421ab7089 Sep 18 23:51:34 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:35 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7357151-cb1d-41cc-8c6a-276421ab7089" returned: 0 in 0.636s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7357151-cb1d-41cc-8c6a-276421ab7089 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:35 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7357151-cb1d-41cc-8c6a-276421ab7089 Sep 18 23:51:35 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:35 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7357151-cb1d-41cc-8c6a-276421ab7089" returned: 0 in 0.425s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Lock "cinder-quobyte-d7357151-cb1d-41cc-8c6a-276421ab7089" released by "delete_volume" :: held 1.137s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:35 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Created reservations ['c5bb1fe9-3cf6-4976-9589-5a2e251840ac', 'a5e4dcf4-f4a7-495a-bd0d-c0f5da5d1475', 'dc1f0003-1164-431f-b7b0-36830ff9c56f', '42e35ee1-1b8d-4080-b9e1-9373077d48a3'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:51:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:35 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:51:35 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:36 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:36 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:51:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Deleted volume successfully. Sep 18 23:51:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a3512c93-8520-438c-829e-bb4a2c61f131 tempest-AttachVolumeTestJSON-268412481 None] Lock "cinder-d7357151-cb1d-41cc-8c6a-276421ab7089-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "cinder-7af9450e-495c-4997-a49b-a931d0d22aaa-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Lock "cinder-7af9450e-495c-4997-a49b-a931d0d22aaa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "cinder-quobyte-7af9450e-495c-4997-a49b-a931d0d22aaa" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Lock "cinder-quobyte-7af9450e-495c-4997-a49b-a931d0d22aaa" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[733af634-29ba-4344-b35c-c1680a429bcb]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:51:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-7af9450e-495c-4997-a49b-a931d0d22aaa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:37 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-7af9450e-495c-4997-a49b-a931d0d22aaa Sep 18 23:51:37 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:37 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-7af9450e-495c-4997-a49b-a931d0d22aaa" returned: 0 in 0.606s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-7af9450e-495c-4997-a49b-a931d0d22aaa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:37 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-7af9450e-495c-4997-a49b-a931d0d22aaa Sep 18 23:51:37 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:37 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-7af9450e-495c-4997-a49b-a931d0d22aaa" returned: 0 in 0.391s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Lock "cinder-quobyte-7af9450e-495c-4997-a49b-a931d0d22aaa" released by "delete_volume" :: held 1.094s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Created reservations ['50baf9a3-25f0-4c55-8ce6-508747ed30f7', '8eaf6ca9-9faf-4b0d-8d81-60fa9d519764', 'fa44989b-c84d-458f-8dbb-74f6a3fac064', 'db1e2978-f5b7-4cbc-a0e4-372d643f07ea'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:51:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:38 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:51:38 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:38 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:38 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:51:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Deleted volume successfully. Sep 18 23:51:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cc38df0f-74cd-4c68-93fd-c039fdb82f69 tempest-AttachVolumeTestJSON-268412481 None] Lock "cinder-7af9450e-495c-4997-a49b-a931d0d22aaa-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "cinder-6b94bfa2-6184-4b70-a09e-fec3480e0bef-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Lock "cinder-6b94bfa2-6184-4b70-a09e-fec3480e0bef-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "cinder-quobyte-6b94bfa2-6184-4b70-a09e-fec3480e0bef" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:51:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Lock "cinder-quobyte-6b94bfa2-6184-4b70-a09e-fec3480e0bef" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:51:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f4ca5-fb11-40ee-ba84-3148642e7575]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:51:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:39 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef Sep 18 23:51:39 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:40 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef" returned: 0 in 0.718s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:40 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef Sep 18 23:51:40 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:40 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6b94bfa2-6184-4b70-a09e-fec3480e0bef" returned: 0 in 0.451s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Lock "cinder-quobyte-6b94bfa2-6184-4b70-a09e-fec3480e0bef" released by "delete_volume" :: held 1.265s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:40 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Created reservations ['8d3bfcab-0aeb-4fd0-830f-5d6913e5fd0d', '210537fa-5bcd-41b7-b411-0c2ba350bd22', 'acc2f135-ff25-4934-9bde-401220a94549', '2182fdbf-6f64-44dd-bc03-3180050f0564'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:51:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:51:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:51:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:51:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:51:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:51:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:40 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:51:40 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:41 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.390s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:41 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:51:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Deleted volume successfully. Sep 18 23:51:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9154b25-bc85-4f45-9eaf-432fc946168d tempest-AttachVolumeTestJSON-268412481 None] Lock "cinder-6b94bfa2-6184-4b70-a09e-fec3480e0bef-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:51:41 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.9b9fcc7d-3fbb-4b3b-939e-09626f61ef141m8hfq0t.img" returned: 0 in 7.499s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ca6be2-477d-409e-bf73-6eb39904458c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:51:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:51:41 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 Sep 18 23:51:41 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:51:42 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Sep 18 23:51:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06" returned: 0 in 0.530s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:51:42 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06, size 1024.00 MB, duration 7.50 sec, destination /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.9b9fcc7d-3fbb-4b3b-939e-09626f61ef141m8hfq0t.img {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:51:42 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] Converted 1024.00 MB image at 136.53 MB/s Sep 18 23:51:42 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] 9b9fcc7d-3fbb-4b3b-939e-09626f61ef14 was raw, no need to convert to raw {{(pid=85963) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 18 23:51:49 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=124,cinder:UPDATE=137,cinder:INSERT=27,cinder:DELETE=4 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:51:49 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=109,cinder:SELECT=115,cinder:INSERT=25,cinder:DELETE=11 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:51:50 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:51:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Flow 'volume_create_manager' (06225a25-0254-4e81-a2f3-34a1f8e3a96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:51:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e22b69-8fb0-4f3d-98fc-0776825b50df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e22b69-8fb0-4f3d-98fc-0776825b50df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1562360643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4524f63e-a9c0-4468-a543-1a1b2fa3b573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20f302f2b394247bcaead38858fef43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:50Z,use_quota=True,user_id='4a8db7db1c614c1cb8a35810469c2cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52435ded-e392-4856-90ec-5019f9d746e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52435ded-e392-4856-90ec-5019f9d746e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a699a389-2655-4f8b-8a5f-cd2ab788e344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a699a389-2655-4f8b-8a5f-cd2ab788e344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4524f63e-a9c0-4468-a543-1a1b2fa3b573', 'volume_name': 'volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64985a6a-1ced-4066-a258-8b4f512662b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64985a6a-1ced-4066-a258-8b4f512662b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:51:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274d72eb-9de2-495a-b50a-61a2f23ea053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:51:50 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Volume 4524f63e-a9c0-4468-a543-1a1b2fa3b573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573', 'volume_size': 1} Sep 18 23:51:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:00 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:52:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.589s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] Uploaded volume to glance image-id: 9b9fcc7d-3fbb-4b3b-939e-09626f61ef14. {{(pid=85963) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 18 23:52:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.732s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-411930423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffd2b6f-f90f-4ea9-aded-00c410822adb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec1ecaa9cefb4b12abbad23f84dc6ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:33Z,use_quota=True,user_id='5e6b3dc681e54cbb8bd319ff46c933c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:52:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Creating volume 9ffd2b6f-f90f-4ea9-aded-00c410822adb {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:52:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:52:01 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:52:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:01 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb 1073741824 Sep 18 23:52:01 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f451e9b4-43b3-411b-86d0-46fc13c4cbb3 tempest-VolumesActionsTest-1123081023 None] Copy volume to image completed successfully. Sep 18 23:52:02 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb 1073741824" returned: 0 in 0.484s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:02 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb Sep 18 23:52:02 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:02 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb" returned: 0 in 0.278s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 26.995s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:02 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Cloning volume 092ae47b-c1b5-4853-b87e-39eb2b5c5821 to volume a686af51-de8e-481c-bf35-30517bf3c024 Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8063b87-579a-4475-bc4b-56c136ab63fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4620722-94b1-48ed-b27c-e2af00106a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Volume volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb (9ffd2b6f-f90f-4ea9-aded-00c410822adb): created successfully Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4620722-94b1-48ed-b27c-e2af00106a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Flow 'volume_create_manager' (72f7cc53-2383-48e5-ab13-46af5df08c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Creating offline snapshot a78f1c6d-38ec-4169-b061-d5fcbe2eac0e of volume 092ae47b-c1b5-4853-b87e-39eb2b5c5821 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:52:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6c3d5416-5ff1-4a48-89c7-d8e4d88d5e6d tempest-VolumesTestJSON-1982083495 None] Created volume successfully. Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2048d26-2115-4139-9bff-f7d89dd19696]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:02 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 Sep 18 23:52:02 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:03 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821" returned: 0 in 0.388s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:03 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e 1G Sep 18 23:52:03 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:03 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e 1G" returned: 0 in 0.445s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:03 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e Sep 18 23:52:03 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Flow 'volume_create_manager' (42a31253-8e36-48ae-9581-bba3f3878d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1b330e-e523-451e-8f00-364b0bde3ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1b330e-e523-451e-8f00-364b0bde3ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-163041777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41c17d5-97fc-487c-a5c0-a1faabd28ca4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec1ecaa9cefb4b12abbad23f84dc6ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:52:04Z,use_quota=True,user_id='5e6b3dc681e54cbb8bd319ff46c933c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd045023-8e91-407f-85f2-e9e2f2bcbf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd045023-8e91-407f-85f2-e9e2f2bcbf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c6a08f-5021-4b76-82d7-4f0688ab0b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c6a08f-5021-4b76-82d7-4f0688ab0b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41c17d5-97fc-487c-a5c0-a1faabd28ca4', 'volume_name': 'volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70319207-e8b2-478b-b102-e358928a8266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70319207-e8b2-478b-b102-e358928a8266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67761154-55b2-4313-9fcc-c6bbb2dba560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Volume c41c17d5-97fc-487c-a5c0-a1faabd28ca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4', 'volume_size': 1} Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:03 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e" returned: 0 in 0.303s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:03 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:52:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:03 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e Sep 18 23:52:03 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:04 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e" returned: 0 in 0.246s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:04 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.info Sep 18 23:52:04 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:04 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.info" returned: 0 in 0.271s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:04 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:04 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.info Sep 18 23:52:04 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:04 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.info" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Acquiring lock "cinder-quobyte-a686af51-de8e-481c-bf35-30517bf3c024" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Lock "cinder-quobyte-a686af51-de8e-481c-bf35-30517bf3c024" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] snapshot: a78f1c6d-38ec-4169-b061-d5fcbe2eac0e, volume: a686af51-de8e-481c-bf35-30517bf3c024, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[da35a49c-37b8-4b0d-a6c9-7479c6767599]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:04 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e Sep 18 23:52:04 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:05 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e" returned: 0 in 0.359s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ad1218-9be7-48c3-be76-4c0ca06d1cef]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:05 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 Sep 18 23:52:05 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:05 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821" returned: 0 in 0.357s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 23:52:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 23:52:05 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Path /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 23:52:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:05 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024 Sep 18 23:52:05 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:11 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024" returned: 0 in 6.352s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:11 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:52:11 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Converted 1024.00 MB image at 161.16 MB/s Sep 18 23:52:11 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:52:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:11 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024 Sep 18 23:52:11 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:12 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Lock "cinder-quobyte-a686af51-de8e-481c-bf35-30517bf3c024" released by "_copy_volume_from_snapshot" :: held 7.389s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Acquiring lock "cinder-quobyte-a78f1c6d-38ec-4169-b061-d5fcbe2eac0e" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Lock "cinder-quobyte-a78f1c6d-38ec-4169-b061-d5fcbe2eac0e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Deleting offline snapshot a78f1c6d-38ec-4169-b061-d5fcbe2eac0e of volume 092ae47b-c1b5-4853-b87e-39eb2b5c5821 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:52:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] snapshot_file for this snap is: volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:52:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[910ebe14-e2af-482b-9a3b-c1bba31e086e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:12 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e Sep 18 23:52:12 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:12 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7a537e-13a5-49f5-8b31-d093976b647b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:12 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 Sep 18 23:52:12 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:13 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821" returned: 0 in 0.519s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:13 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e Sep 18 23:52:13 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:13 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e" returned: 0 in 0.325s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:13 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e Sep 18 23:52:13 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:13 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821.a78f1c6d-38ec-4169-b061-d5fcbe2eac0e" returned: 0 in 0.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Lock "cinder-quobyte-a78f1c6d-38ec-4169-b061-d5fcbe2eac0e" released by "_delete_snapshot" :: held 1.541s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.058s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.627s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1562360643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4524f63e-a9c0-4468-a543-1a1b2fa3b573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d20f302f2b394247bcaead38858fef43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:51:50Z,use_quota=True,user_id='4a8db7db1c614c1cb8a35810469c2cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Creating volume 4524f63e-a9c0-4468-a543-1a1b2fa3b573 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:52:13 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:52:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:13 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 1073741824 Sep 18 23:52:13 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-35bd4d85-de83-4f9f-b3d6-9a2eb04d38e7 tempest-GroupsV314Test-1596703490 None] Create group from source-group-8024f6b7-f855-4d0b-8303-5bad6f343209 completed successfully. Sep 18 23:52:14 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 1073741824" returned: 0 in 0.424s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:14 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 Sep 18 23:52:14 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:14 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573" returned: 0 in 0.257s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 11.460s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274d72eb-9de2-495a-b50a-61a2f23ea053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af7cc85-b464-473a-a846-96e128395505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4a4727-c294-4aba-adbb-4bef47548de4]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Volume volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 (4524f63e-a9c0-4468-a543-1a1b2fa3b573): created successfully Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af7cc85-b464-473a-a846-96e128395505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Flow 'volume_create_manager' (06225a25-0254-4e81-a2f3-34a1f8e3a96c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:52:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-2d1e870c-04c5-4906-88d1-b3e7f398a940 req-3f79787f-ddb1-4c97-aec5-01bb551939d0 tempest-VolumesSnapshotsTestJSON-228777462 None] Created volume successfully. Sep 18 23:52:14 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 Sep 18 23:52:14 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Acquiring lock "cinder-quobyte-a686af51-de8e-481c-bf35-30517bf3c024" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Lock "cinder-quobyte-a686af51-de8e-481c-bf35-30517bf3c024" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbb6993-bca0-4b23-a448-286ada88b385]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:14 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06" returned: 0 in 0.379s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec43f8f-5b68-43c4-954c-1e90cb4e137d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:14 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024 Sep 18 23:52:14 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:14 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 Sep 18 23:52:14 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:15 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024" returned: 0 in 0.386s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:15 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024 Sep 18 23:52:15 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:15 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06" returned: 0 in 0.395s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:15 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img Sep 18 23:52:15 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:15 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a686af51-de8e-481c-bf35-30517bf3c024" returned: 0 in 0.293s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Lock "cinder-quobyte-a686af51-de8e-481c-bf35-30517bf3c024" released by "delete_volume" :: held 0.734s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Created reservations ['616fbc81-3c14-401b-b5c2-2683a56118d7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:15 devstack cinder-volume[85963]: WARNING cinder.quota [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-407423709 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-407423709, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:52:15 devstack cinder-volume[85963]: WARNING cinder.quota [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-407423709 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-407423709, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Created reservations ['9d1fcdc5-b0be-45f7-83dc-10445f8db427', '502fc34f-271c-41a4-a2c3-0d768f86a00c', '19559978-602d-4d8d-adf1-8a890b1fcebe', '4e79bb24-97f4-42ff-bed0-a55891e08c8b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:15 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:52:15 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:16 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.649s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:16 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:52:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6c42757b-cde0-4453-a58c-20724f7acf44 tempest-GroupsV314Test-1596703490 None] Delete group completed successfully. Sep 18 23:52:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Acquiring lock "cinder-quobyte-092ae47b-c1b5-4853-b87e-39eb2b5c5821" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Lock "cinder-quobyte-092ae47b-c1b5-4853-b87e-39eb2b5c5821" acquired by "delete_volume" :: waited 0.055s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea11b0b-cef8-4959-9abf-e86aa042c0c2]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:17 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 Sep 18 23:52:17 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:17 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821" returned: 0 in 0.904s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:17 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821 Sep 18 23:52:17 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:18 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-092ae47b-c1b5-4853-b87e-39eb2b5c5821" returned: 0 in 0.372s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Lock "cinder-quobyte-092ae47b-c1b5-4853-b87e-39eb2b5c5821" released by "delete_volume" :: held 1.422s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:18 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Created reservations ['a52da400-8de1-40d4-8a0b-d00296fa1d9f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:18 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Created reservations ['a859bc5a-f6f8-4c6e-856a-94e93ca66428', '276c5f9c-1526-4abc-987b-fa57068ff994', 'f3750746-94dd-43eb-bb35-2c55e3a2e302', 'a322bc7e-7343-4e38-ad01-61dc1a42bc57'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:18 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:52:18 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:19 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.442s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:19 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:52:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2054f95b-4fed-4dd3-9e82-2b2508d48501 tempest-GroupsV314Test-1596703490 None] Delete group completed successfully. Sep 18 23:52:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:52:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:21 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:52:21 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:21 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.579s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:52:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:52:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:52:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:52:22 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img" returned: 0 in 7.455s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8935da8-b436-4eb5-935e-bd6909343e19]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:22 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 Sep 18 23:52:22 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:23 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06" returned: 0 in 0.562s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:23 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06, size 1024.00 MB, duration 7.46 sec, destination /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:52:23 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Converted 1024.00 MB image at 137.34 MB/s Sep 18 23:52:23 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] 1c2ba8b5-e098-4550-9e3c-33f19f789985 was raw, converting to qcow2 {{(pid=85963) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 18 23:52:23 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675bbd3-2394-4368-b517-2f46c0d170da]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:23 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img Sep 18 23:52:23 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:23 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img" returned: 0 in 0.334s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:23 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img Sep 18 23:52:23 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:24 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img" returned: 1 in 0.336s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 23:52:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img /opt/stack/data/cinder/conversion/vol_upload_p09l9eud {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:24 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img /opt/stack/data/cinder/conversion/vol_upload_p09l9eud Sep 18 23:52:24 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:24 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img /opt/stack/data/cinder/conversion/vol_upload_p09l9eud" returned: 0 in 0.255s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:24 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Image conversion details: src /opt/stack/data/cinder/conversion/27f3f954-46af-45be-9fdf-7f9b12727c06.temp_image.1c2ba8b5-e098-4550-9e3c-33f19f7899851wuts4rh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_p09l9eud {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:52:24 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 18 23:52:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d166637-dae2-43af-af2b-f4c4cb5a7b7d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p09l9eud {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:24 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p09l9eud Sep 18 23:52:24 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:24 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_p09l9eud" returned: 0 in 0.327s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.569s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Uploaded volume to glance image-id: 1c2ba8b5-e098-4550-9e3c-33f19f789985. {{(pid=85963) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.231s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-163041777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41c17d5-97fc-487c-a5c0-a1faabd28ca4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec1ecaa9cefb4b12abbad23f84dc6ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:52:04Z,use_quota=True,user_id='5e6b3dc681e54cbb8bd319ff46c933c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Creating volume c41c17d5-97fc-487c-a5c0-a1faabd28ca4 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:52:26 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:26 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4 1073741824 Sep 18 23:52:26 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a4d48b47-ced5-4d81-9aee-5475acd18425 tempest-VolumesActionsTest-1123081023 None] Copy volume to image completed successfully. Sep 18 23:52:26 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4 1073741824" returned: 0 in 0.477s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:26 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4 Sep 18 23:52:26 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Flow 'volume_create_manager' (6e290640-f4b0-45e1-ae55-183ac4ae0216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af58b1ff-eeff-4785-bb82-d6edb6057694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af58b1ff-eeff-4785-bb82-d6edb6057694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1826042738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29fe397d-c6bf-465a-9481-65b4affa3393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e0e597b09e6499ba59168e29fb68fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:52:27Z,use_quota=True,user_id='45f1e3a9178b43f39caa5121297ee17d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b319a3-fcc3-48b9-b936-c0f7f852cf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b319a3-fcc3-48b9-b936-c0f7f852cf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f23714-5cd5-4c08-9ed6-39ca1d31f4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f23714-5cd5-4c08-9ed6-39ca1d31f4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29fe397d-c6bf-465a-9481-65b4affa3393', 'volume_name': 'volume-29fe397d-c6bf-465a-9481-65b4affa3393', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f029e4-69bb-430f-84ed-5dcf2ccf3af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f029e4-69bb-430f-84ed-5dcf2ccf3af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b404a0df-4c7d-4410-bfa4-4b4edba9fcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Volume 29fe397d-c6bf-465a-9481-65b4affa3393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29fe397d-c6bf-465a-9481-65b4affa3393', 'volume_size': 1} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:26 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4" returned: 0 in 0.299s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.318s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67761154-55b2-4313-9fcc-c6bbb2dba560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8dce88e-814c-4af5-83a3-b9f926b361c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] Creating offline snapshot beb41c52-b5e4-4bb9-b12b-33a83f4fc498 of volume 4524f63e-a9c0-4468-a543-1a1b2fa3b573 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8d5c59-cb0f-4e3e-a333-0e47c078c25e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Volume volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4 (c41c17d5-97fc-487c-a5c0-a1faabd28ca4): created successfully Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8dce88e-814c-4af5-83a3-b9f926b361c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Flow 'volume_create_manager' (42a31253-8e36-48ae-9581-bba3f3878d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:52:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-89ec5ce6-9396-4e1c-becb-8d0f19be1f0f tempest-VolumesTestJSON-1982083495 None] Created volume successfully. Sep 18 23:52:27 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 Sep 18 23:52:27 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:27 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573" returned: 0 in 0.388s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:27 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 1G Sep 18 23:52:27 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Acquiring lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Acquiring lock "cinder-quobyte-27f3f954-46af-45be-9fdf-7f9b12727c06" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Lock "cinder-quobyte-27f3f954-46af-45be-9fdf-7f9b12727c06" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91917bf-a743-4a6c-999c-5cf24292cac0]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:27 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 1G" returned: 0 in 0.498s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:27 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 Sep 18 23:52:27 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:27 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 Sep 18 23:52:27 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:28 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498" returned: 0 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:28 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 is being set with open permissions: ugo+rw Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:28 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 Sep 18 23:52:28 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:28 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06" returned: 0 in 0.417s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:28 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06 Sep 18 23:52:28 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:28 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498" returned: 0 in 0.266s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:28 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27f3f954-46af-45be-9fdf-7f9b12727c06" returned: 0 in 0.291s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:28 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.info Sep 18 23:52:28 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Lock "cinder-quobyte-27f3f954-46af-45be-9fdf-7f9b12727c06" released by "delete_volume" :: held 0.761s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Created reservations ['de8ee6ab-06ed-4785-989e-68fa3622188b', 'fbf13fe1-081d-4d36-aecd-3e746ff67fb9', 'afd185b9-5fcd-49aa-b8f1-70191924fa7a', '1c6b277e-7416-4cab-8738-713aa2fee2e4'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Acquiring lock "cinder-c41c17d5-97fc-487c-a5c0-a1faabd28ca4-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Lock "cinder-c41c17d5-97fc-487c-a5c0-a1faabd28ca4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:28 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:52:28 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Acquiring lock "cinder-quobyte-c41c17d5-97fc-487c-a5c0-a1faabd28ca4" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Lock "cinder-quobyte-c41c17d5-97fc-487c-a5c0-a1faabd28ca4" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dedd3ca-c6c1-4fd7-9eff-1043e97fd8b4]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:28 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.info" returned: 0 in 0.346s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:28 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.info is being set with open permissions: ugo+rw Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:28 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.info Sep 18 23:52:28 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:28 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4 Sep 18 23:52:28 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:28 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.316s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:28 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:52:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Deleted volume successfully. Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d8db80d-8b57-46e6-9c95-fe3a33622f96 tempest-VolumesActionsTest-1123081023 None] Lock "cinder-27f3f954-46af-45be-9fdf-7f9b12727c06-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:29 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.info" returned: 0 in 0.299s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.323s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1826042738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29fe397d-c6bf-465a-9481-65b4affa3393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e0e597b09e6499ba59168e29fb68fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:52:27Z,use_quota=True,user_id='45f1e3a9178b43f39caa5121297ee17d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Creating volume 29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:52:29 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:29 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 1073741824 Sep 18 23:52:29 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-c147b177-23ca-44ee-93f7-91b301c1712f req-62b1bd30-6edf-45bd-844f-0842fb8309de tempest-VolumesSnapshotsTestJSON-228777462 None] Create snapshot completed successfully Sep 18 23:52:29 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:29 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4 Sep 18 23:52:29 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:29 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41c17d5-97fc-487c-a5c0-a1faabd28ca4" returned: 0 in 0.278s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Lock "cinder-quobyte-c41c17d5-97fc-487c-a5c0-a1faabd28ca4" released by "delete_volume" :: held 0.774s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Created reservations ['5fa0b402-fee2-4320-bc32-b679718d3cba', '17178643-be8b-49fa-aef3-acd3c3067b18', 'a1d1ba25-8857-434f-8870-3b0bb3b7bab5', '8b81b527-056f-4a23-9862-e4696dce09d0'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:29 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 1073741824" returned: 0 in 0.526s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:29 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:52:29 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:29 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 Sep 18 23:52:29 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Acquiring lock "cinder-9ffd2b6f-f90f-4ea9-aded-00c410822adb-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Lock "cinder-9ffd2b6f-f90f-4ea9-aded-00c410822adb-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Acquiring lock "cinder-quobyte-9ffd2b6f-f90f-4ea9-aded-00c410822adb" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Lock "cinder-quobyte-9ffd2b6f-f90f-4ea9-aded-00c410822adb" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89e05bd-4478-4fb6-9455-9be78cec64e9]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:30 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:30 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.395s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393" returned: 0 in 0.344s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Deleted volume successfully. Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b404a0df-4c7d-4410-bfa4-4b4edba9fcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29fe397d-c6bf-465a-9481-65b4affa3393', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e17c7c8-268e-40ce-ae91-3418f4e49f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:30 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Volume volume-29fe397d-c6bf-465a-9481-65b4affa3393 (29fe397d-c6bf-465a-9481-65b4affa3393): created successfully Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e17c7c8-268e-40ce-ae91-3418f4e49f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Flow 'volume_create_manager' (6e290640-f4b0-45e1-ae55-183ac4ae0216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-001f79f4-2ffd-4397-9462-f25f455f2ffc tempest-VolumesTestJSON-1982083495 None] Lock "cinder-c41c17d5-97fc-487c-a5c0-a1faabd28ca4-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e77c7045-070c-4859-99a9-222298cfcb56 tempest-SnapshotsActionsTest-169566142 None] Created volume successfully. Sep 18 23:52:30 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb Sep 18 23:52:30 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Acquiring lock "cinder-beb41c52-b5e4-4bb9-b12b-33a83f4fc498-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "cinder-beb41c52-b5e4-4bb9-b12b-33a83f4fc498-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Acquiring lock "cinder-quobyte-4524f63e-a9c0-4468-a543-1a1b2fa3b573" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "cinder-quobyte-4524f63e-a9c0-4468-a543-1a1b2fa3b573" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Acquiring lock "cinder-quobyte-beb41c52-b5e4-4bb9-b12b-33a83f4fc498" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "cinder-quobyte-beb41c52-b5e4-4bb9-b12b-33a83f4fc498" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Deleting offline snapshot beb41c52-b5e4-4bb9-b12b-33a83f4fc498 of volume 4524f63e-a9c0-4468-a543-1a1b2fa3b573 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] snapshot_file for this snap is: volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a17c231-0040-4d73-9e40-038800c94533]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:30 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 Sep 18 23:52:30 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:30 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb" returned: 0 in 0.452s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:30 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb Sep 18 23:52:30 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:30 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498" returned: 0 in 0.418s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[65271d81-ca5a-4f6f-adf8-c2767319e284]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:30 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ffd2b6f-f90f-4ea9-aded-00c410822adb" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Lock "cinder-quobyte-9ffd2b6f-f90f-4ea9-aded-00c410822adb" released by "delete_volume" :: held 0.864s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Created reservations ['a96c5907-5ede-46be-821c-84de4c541d2f', '5d86db7a-3d7f-485b-9c91-7bd852fe93dc', 'b9a7c6fd-3392-435d-b2c1-8d2c27ed66a9', '83bc50d3-343c-4824-a962-021e9acee78b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:30 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 Sep 18 23:52:30 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:31 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:52:31 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Acquiring lock "cinder-980018a1-3b76-4664-b78a-8c4b1bb7dd18-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Lock "cinder-980018a1-3b76-4664-b78a-8c4b1bb7dd18-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Acquiring lock "cinder-quobyte-980018a1-3b76-4664-b78a-8c4b1bb7dd18" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:31 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Lock "cinder-quobyte-980018a1-3b76-4664-b78a-8c4b1bb7dd18" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573" returned: 0 in 0.528s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[37524d50-41aa-4917-844d-0d732312861c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:31 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:52:31 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 Sep 18 23:52:31 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Deleted volume successfully. Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7a9f9e3c-adc0-4712-99ba-d2b4e8a03436 tempest-VolumesTestJSON-1982083495 None] Lock "cinder-9ffd2b6f-f90f-4ea9-aded-00c410822adb-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] Creating offline snapshot 3d27257e-b430-48c1-9167-0696f4ff3f95 of volume 29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d549841-00a0-48ec-9a91-cafe7abc326e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:31 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18 Sep 18 23:52:31 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:31 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 Sep 18 23:52:31 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:31 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498" returned: 0 in 0.540s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:31 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18" returned: 0 in 0.523s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:31 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498 Sep 18 23:52:31 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:31 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18 Sep 18 23:52:31 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:31 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393" returned: 0 in 0.452s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:31 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 1G Sep 18 23:52:31 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:32 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-980018a1-3b76-4664-b78a-8c4b1bb7dd18" returned: 0 in 0.260s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:32 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573.beb41c52-b5e4-4bb9-b12b-33a83f4fc498" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Lock "cinder-quobyte-980018a1-3b76-4664-b78a-8c4b1bb7dd18" released by "delete_volume" :: held 0.861s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "cinder-quobyte-beb41c52-b5e4-4bb9-b12b-33a83f4fc498" released by "_delete_snapshot" :: held 1.910s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "cinder-quobyte-4524f63e-a9c0-4468-a543-1a1b2fa3b573" released by "delete_snapshot" :: held 1.939s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Created reservations ['7e1999ea-4b2b-48df-8966-8ed4328e0850', '66bcec42-5c98-41e8-aedb-6b591f474e2d', '0cf4563e-e947-4a61-92e7-179ab270976c', 'e75d06a2-1774-4731-b4f3-6f7700fc0a61'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.quota [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Created reservations ['daf55d3b-e7d9-457a-b6e0-e61bb0a7165d', '533f2e11-f4af-4f8b-b6d0-7de3d0142595', '3012e69f-1908-48b5-a380-e5b1d57ba4a7', '66cbe5b8-0cc1-435d-ad99-003ba838e9e5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:32 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:52:32 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Delete snapshot completed successfully. Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-86d30002-6bca-4f79-8e97-a987674d3fef req-dcd28ce2-a10b-450b-9d70-641dfdc42179 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "cinder-beb41c52-b5e4-4bb9-b12b-33a83f4fc498-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:32 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 1G" returned: 0 in 0.490s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:32 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:52:32 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Acquiring lock "cinder-4524f63e-a9c0-4468-a543-1a1b2fa3b573-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "cinder-4524f63e-a9c0-4468-a543-1a1b2fa3b573-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Acquiring lock "cinder-quobyte-4524f63e-a9c0-4468-a543-1a1b2fa3b573" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:32 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.411s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:52:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Deleted volume successfully. Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "cinder-quobyte-4524f63e-a9c0-4468-a543-1a1b2fa3b573" acquired by "delete_volume" :: waited 0.043s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[603ba407-7361-4743-b350-026783a88f3b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9697b542-fc86-49ae-a770-b666341c2c81 tempest-VolumesTestJSON-1982083495 None] Lock "cinder-980018a1-3b76-4664-b78a-8c4b1bb7dd18-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:32 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.518s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:32 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 is being set with open permissions: ugo+rw Sep 18 23:52:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:32 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 Sep 18 23:52:32 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:33 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:52:33 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:33 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.348s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:33 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573" returned: 0 in 0.511s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:33 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573 Sep 18 23:52:33 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:33 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.info Sep 18 23:52:33 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:33 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4524f63e-a9c0-4468-a543-1a1b2fa3b573" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "cinder-quobyte-4524f63e-a9c0-4468-a543-1a1b2fa3b573" released by "delete_volume" :: held 0.897s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG cinder.quota [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Created reservations ['f9da9561-916e-40c7-aaea-fc85e9582762', '3e091c23-6e0d-4f43-bde7-f10393df6d0b', '3fab210e-5031-463f-829f-bfb8d7cd8e2d', 'f86fd60b-1710-4d69-aa51-7c30b3dbacb6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:33 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.info" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:33 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.info is being set with open permissions: ugo+rw Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:33 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.info Sep 18 23:52:33 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:33 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:52:33 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:34 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.info" returned: 0 in 0.486s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.803s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-77aff491-5879-41c0-9a06-8fa5f495c1d4 tempest-SnapshotsActionsTest-169566142 None] Create snapshot completed successfully Sep 18 23:52:34 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.485s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:34 devstack cinder-volume[85963]: DEBUG cinder.manager [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:52:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Deleted volume successfully. Sep 18 23:52:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-19ef3758-fd9c-407f-be93-ff23b3611308 req-faba5a48-6df5-4d28-af04-046b16ebf3c1 tempest-VolumesSnapshotsTestJSON-228777462 None] Lock "cinder-4524f63e-a9c0-4468-a543-1a1b2fa3b573-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] Creating offline snapshot 2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 of volume 29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:52:35 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d959520-1c8f-465d-92e6-25905dcc98dd]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:35 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:52:35 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:36 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.523s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:36 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 1G Sep 18 23:52:36 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:36 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 1G" returned: 0 in 0.533s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:36 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 Sep 18 23:52:36 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:36 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2" returned: 0 in 0.334s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:36 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 is being set with open permissions: ugo+rw Sep 18 23:52:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:37 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 Sep 18 23:52:37 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:37 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b1a9c391-8a33-4a66-8359-1df6fcc78592 tempest-SnapshotsActionsTest-169566142 None] Create snapshot completed successfully Sep 18 23:52:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Acquiring lock "cinder-2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Acquiring lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Acquiring lock "cinder-quobyte-2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Deleting offline snapshot 2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 of volume 29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:52:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] snapshot_file for this snap is: volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:52:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[353698d7-8074-401b-a978-990f1fabab09]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:37 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 Sep 18 23:52:37 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:38 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2" returned: 0 in 0.415s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd196d39-0932-43a8-aa74-1288e1267987]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:38 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:52:38 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:38 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.509s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:38 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 Sep 18 23:52:38 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Flow 'volume_create_manager' (7f4de35f-2065-49b7-a86c-f64e0318a6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1558d2-511f-475a-aee3-e2bd7f93c60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1558d2-511f-475a-aee3-e2bd7f93c60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1204529217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0e6a92-a1e7-497d-afd8-593819204897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cedba03efc5d4b30b9ad3b1ec647ae30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:52:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:52:39Z,use_quota=True,user_id='485b76227ac64dbaa18ee8d68b19226c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff5cad8-0c5e-45b7-a3d1-6df8b0ae164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff5cad8-0c5e-45b7-a3d1-6df8b0ae164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb367213-d969-4121-bffe-603dca2b4111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb367213-d969-4121-bffe-603dca2b4111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0e6a92-a1e7-497d-afd8-593819204897', 'volume_name': 'volume-3e0e6a92-a1e7-497d-afd8-593819204897', 'volume_size': 2}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee83aad-7679-4920-ad9d-7eac396da13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee83aad-7679-4920-ad9d-7eac396da13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52662063-8cb1-41b8-991a-39d505fb2995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:39 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Volume 3e0e6a92-a1e7-497d-afd8-593819204897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0e6a92-a1e7-497d-afd8-593819204897', 'volume_size': 2} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1204529217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0e6a92-a1e7-497d-afd8-593819204897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cedba03efc5d4b30b9ad3b1ec647ae30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:52:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:52:39Z,use_quota=True,user_id='485b76227ac64dbaa18ee8d68b19226c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Creating volume 3e0e6a92-a1e7-497d-afd8-593819204897 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:52:39 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3e0e6a92-a1e7-497d-afd8-593819204897 2147483648 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:39 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3e0e6a92-a1e7-497d-afd8-593819204897 2147483648 Sep 18 23:52:39 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:39 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2" returned: 0 in 0.519s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:39 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2 Sep 18 23:52:39 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:39 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:39 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3e0e6a92-a1e7-497d-afd8-593819204897 2147483648" returned: 0 in 0.691s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2" released by "_delete_snapshot" :: held 1.949s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" released by "delete_snapshot" :: held 1.981s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3e0e6a92-a1e7-497d-afd8-593819204897 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:39 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3e0e6a92-a1e7-497d-afd8-593819204897 Sep 18 23:52:39 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Created reservations ['8b458211-ba3b-4bde-b0fc-eeb70663c269', 'e61b5855-e0be-4381-9ff6-23d738e1790d', '2b9b8f82-99a5-46dd-9e28-422a46946655', '9b837c45-3ab0-431c-884d-6083275af1c8'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Delete snapshot completed successfully. Sep 18 23:52:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2d04280c-702a-4f9a-a05e-7dd0b8a1caba tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-2f78f0b9-39ba-45ce-831f-c6aeaf0ae8f2-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:40 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3e0e6a92-a1e7-497d-afd8-593819204897" returned: 0 in 0.314s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:52:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52662063-8cb1-41b8-991a-39d505fb2995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0e6a92-a1e7-497d-afd8-593819204897', 'volume_size': 2}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6298365-00a7-4ee0-ad58-1473d12649f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:40 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Volume volume-3e0e6a92-a1e7-497d-afd8-593819204897 (3e0e6a92-a1e7-497d-afd8-593819204897): created successfully Sep 18 23:52:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6298365-00a7-4ee0-ad58-1473d12649f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Flow 'volume_create_manager' (7f4de35f-2065-49b7-a86c-f64e0318a6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:52:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-25546f09-efd0-4c07-ae2e-947d37f8be10 tempest-VolumesCloneNegativeTest-451228699 None] Created volume successfully. Sep 18 23:52:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9cd47ef0-6c7d-498e-8698-84bc352cba33 tempest-GroupSnapshotsTest-617357259 None] Group tempest-GroupSnapshotsTest-Group-1851517070: creating Sep 18 23:52:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9cd47ef0-6c7d-498e-8698-84bc352cba33 tempest-GroupSnapshotsTest-617357259 None] Group tempest-GroupSnapshotsTest-Group-1851517070: created successfully Sep 18 23:52:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9cd47ef0-6c7d-498e-8698-84bc352cba33 tempest-GroupSnapshotsTest-617357259 None] Create group completed successfully. Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Acquiring lock "cinder-3e0e6a92-a1e7-497d-afd8-593819204897-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Lock "cinder-3e0e6a92-a1e7-497d-afd8-593819204897-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Acquiring lock "cinder-quobyte-3e0e6a92-a1e7-497d-afd8-593819204897" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Lock "cinder-quobyte-3e0e6a92-a1e7-497d-afd8-593819204897" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afb330e-03b1-4261-ab1d-d2e345612937]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3e0e6a92-a1e7-497d-afd8-593819204897 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:41 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3e0e6a92-a1e7-497d-afd8-593819204897 Sep 18 23:52:41 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] Creating offline snapshot da2ec30c-4482-4cef-bafb-6acc7c17c38c of volume 29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dd4cba-29fc-4f37-99c5-3f952615d452]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:41 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:52:41 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:41 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3e0e6a92-a1e7-497d-afd8-593819204897" returned: 0 in 0.484s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3e0e6a92-a1e7-497d-afd8-593819204897 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:41 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3e0e6a92-a1e7-497d-afd8-593819204897 Sep 18 23:52:41 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:41 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.484s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:42 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c 1G Sep 18 23:52:42 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:42 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3e0e6a92-a1e7-497d-afd8-593819204897" returned: 0 in 0.319s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Lock "cinder-quobyte-3e0e6a92-a1e7-497d-afd8-593819204897" released by "delete_volume" :: held 0.878s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Created reservations ['a6d0e994-90c3-43a6-a1b1-fb316f3e0144', '9ee71306-9d8a-4899-bb7b-ed68c80339c7', 'c66702ba-1ecc-4c8c-858a-7ee9a7d42475', '41ac6d69-c6aa-4b0b-8aa8-b6ff91b4b51e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:52:42 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:52:42 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Flow 'volume_create_manager' (4d1e0740-1f77-4784-9040-157c70a0bcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64bef24-3432-4b73-9599-ea4f35010e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64bef24-3432-4b73-9599-ea4f35010e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-729243639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a356d640-c8f9-4bc2-a54c-79c72e25fc11,host='devstack@QuobyteHD#QuobyteHD',id=9ec4f053-f48d-4045-ba79-efb46509d9fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec88b46d65574b3bbde675f582502e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:52:42Z,use_quota=True,user_id='2a7d2e87ac3c4b05a0f1ded8a60056d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(630a2ec8-9cde-4ca0-8d19-d28bf1ff8154),volume_type_id=630a2ec8-9cde-4ca0-8d19-d28bf1ff8154)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46347659-1f29-4faa-91b5-024b584d0a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46347659-1f29-4faa-91b5-024b584d0a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbf08a6-010a-4b59-a8f4-765c26776e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbf08a6-010a-4b59-a8f4-765c26776e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec4f053-f48d-4045-ba79-efb46509d9fd', 'volume_name': 'volume-9ec4f053-f48d-4045-ba79-efb46509d9fd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bd89b8-8ce4-4842-8b96-9edf582d20bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bd89b8-8ce4-4842-8b96-9edf582d20bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ad753d-91e1-4163-bcd3-f0baa879499d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:42 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Volume 9ec4f053-f48d-4045-ba79-efb46509d9fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec4f053-f48d-4045-ba79-efb46509d9fd', 'volume_size': 1} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:42 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c 1G" returned: 0 in 0.567s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:42 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:52:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Deleted volume successfully. Sep 18 23:52:42 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c Sep 18 23:52:42 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c5a97668-0820-4d51-b09d-02c6f2feb217 tempest-VolumesCloneNegativeTest-451228699 None] Lock "cinder-3e0e6a92-a1e7-497d-afd8-593819204897-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:42 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c" returned: 0 in 0.335s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:42 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c is being set with open permissions: ugo+rw Sep 18 23:52:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:42 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c Sep 18 23:52:42 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:43 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.788s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a356d640-c8f9-4bc2-a54c-79c72e25fc11,created_at=2026-09-18T21:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-729243639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a356d640-c8f9-4bc2-a54c-79c72e25fc11,host='devstack@QuobyteHD#QuobyteHD',id=9ec4f053-f48d-4045-ba79-efb46509d9fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec88b46d65574b3bbde675f582502e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:52:42Z,use_quota=True,user_id='2a7d2e87ac3c4b05a0f1ded8a60056d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(630a2ec8-9cde-4ca0-8d19-d28bf1ff8154),volume_type_id=630a2ec8-9cde-4ca0-8d19-d28bf1ff8154)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Creating volume 9ec4f053-f48d-4045-ba79-efb46509d9fd {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:52:43 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:43 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd 1073741824 Sep 18 23:52:43 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6ab365f9-fb0f-45e6-ab3e-f55380978089 tempest-SnapshotsActionsTest-169566142 None] Create snapshot completed successfully Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Acquiring lock "cinder-da2ec30c-4482-4cef-bafb-6acc7c17c38c-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-da2ec30c-4482-4cef-bafb-6acc7c17c38c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Acquiring lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Acquiring lock "cinder-quobyte-da2ec30c-4482-4cef-bafb-6acc7c17c38c" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-da2ec30c-4482-4cef-bafb-6acc7c17c38c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Deleting offline snapshot da2ec30c-4482-4cef-bafb-6acc7c17c38c of volume 29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] snapshot_file for this snap is: volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbc5b33-0c9c-430a-9cbf-cc7722c2d4c1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:43 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd 1073741824" returned: 0 in 0.648s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:43 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd Sep 18 23:52:43 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:43 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c Sep 18 23:52:43 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:44 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd" returned: 0 in 0.341s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ad753d-91e1-4163-bcd3-f0baa879499d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec4f053-f48d-4045-ba79-efb46509d9fd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df611243-096a-41da-8608-ddb020cca1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:44 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:44 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Volume volume-9ec4f053-f48d-4045-ba79-efb46509d9fd (9ec4f053-f48d-4045-ba79-efb46509d9fd): created successfully Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df611243-096a-41da-8608-ddb020cca1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Flow 'volume_create_manager' (4d1e0740-1f77-4784-9040-157c70a0bcfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c" returned: 0 in 0.470s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4a8ee235-43e1-4624-983b-50cd74f5c4df tempest-GroupSnapshotsTest-617357259 None] Created volume successfully. Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29917af-e392-45f3-8b02-e2e8c27e4c0d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:44 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:52:44 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] GroupSnapshot a920309d-665a-40cd-989e-19fe2bd97f4e: creating. Sep 18 23:52:44 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.531s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] Group snapshot a920309d-665a-40cd-989e-19fe2bd97f4e: creating. {{(pid=85963) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:44 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:44 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] Creating offline snapshot 9283ba2d-7cb6-4e8c-9746-340840f056a0 of volume 9ec4f053-f48d-4045-ba79-efb46509d9fd {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[73971af3-ab78-453c-946f-05d881c7ec2b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:45 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd Sep 18 23:52:45 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:45 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c" returned: 0 in 0.512s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:45 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd" returned: 0 in 0.452s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:45 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c Sep 18 23:52:45 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:45 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 1G Sep 18 23:52:45 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:45 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.da2ec30c-4482-4cef-bafb-6acc7c17c38c" returned: 0 in 0.366s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-da2ec30c-4482-4cef-bafb-6acc7c17c38c" released by "_delete_snapshot" :: held 2.040s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" released by "delete_snapshot" :: held 2.078s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:45 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Created reservations ['6f801032-cc37-455a-9897-953f6558e859', '9fab79cd-7f7d-47b0-8667-49c19e2113aa', '64b11f30-aeb9-4e11-8367-bece1d7b8cb0', '40b90bc1-f108-41b8-86c2-0a9a702334fd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Delete snapshot completed successfully. Sep 18 23:52:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f402b146-9f4a-464e-b449-5486d594c119 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-da2ec30c-4482-4cef-bafb-6acc7c17c38c-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:46 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 1G" returned: 0 in 0.645s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec4f053-f48d-4045-ba79-efb46509d9fd -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:46 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec4f053-f48d-4045-ba79-efb46509d9fd -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 Sep 18 23:52:46 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:46 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec4f053-f48d-4045-ba79-efb46509d9fd -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:46 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:52:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:46 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 Sep 18 23:52:46 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:46 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0" returned: 0 in 0.291s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:46 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.info Sep 18 23:52:46 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:47 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.info" returned: 0 in 0.332s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:47 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:52:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:47 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.info Sep 18 23:52:47 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:47 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.info" returned: 0 in 0.374s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.556s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.064s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] Creating offline snapshot 14b7cc23-6753-400c-807a-4f8c489ea74f of volume 29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:52:47 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2986f0f7-dc39-4176-a1a0-c382a4cc3668]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b2fcb543-2cce-4865-8c60-dff25cb29f16 tempest-GroupSnapshotsTest-617357259 None] group_snapshot a920309d-665a-40cd-989e-19fe2bd97f4e: created successfully Sep 18 23:52:47 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:52:47 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:48 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.457s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:48 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f 1G Sep 18 23:52:48 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:48 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f 1G" returned: 0 in 0.629s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:48 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f Sep 18 23:52:48 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:49 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f" returned: 0 in 0.413s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:49 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f is being set with open permissions: ugo+rw Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:49 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f Sep 18 23:52:49 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:49 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f" returned: 0 in 0.303s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.419s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-9283ba2d-7cb6-4e8c-9746-340840f056a0-c65b61ef-9603-440a-9929-859c33a809a2" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-9283ba2d-7cb6-4e8c-9746-340840f056a0-c65b61ef-9603-440a-9929-859c33a809a2" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Creating volume c65b61ef-9603-440a-9929-859c33a809a2 from snapshot 9283ba2d-7cb6-4e8c-9746-340840f056a0 {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-c65b61ef-9603-440a-9929-859c33a809a2" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d2d1fe8a-c974-49c0-867d-78212c22986a tempest-SnapshotsActionsTest-169566142 None] Create snapshot completed successfully Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-c65b61ef-9603-440a-9929-859c33a809a2" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] snapshot: 9283ba2d-7cb6-4e8c-9746-340840f056a0, volume: c65b61ef-9603-440a-9929-859c33a809a2, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b3db2a-f6df-45bd-856e-2b0562cb7a5e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:49 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 Sep 18 23:52:49 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Acquiring lock "cinder-14b7cc23-6753-400c-807a-4f8c489ea74f-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-14b7cc23-6753-400c-807a-4f8c489ea74f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Acquiring lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Acquiring lock "cinder-quobyte-14b7cc23-6753-400c-807a-4f8c489ea74f" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-14b7cc23-6753-400c-807a-4f8c489ea74f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Deleting offline snapshot 14b7cc23-6753-400c-807a-4f8c489ea74f of volume 29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] snapshot_file for this snap is: volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a61971-02da-4fe7-9ab3-b896c5865aae]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:50 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0" returned: 0 in 0.556s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ec4f053-f48d-4045-ba79-efb46509d9fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:50 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f Sep 18 23:52:50 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[585ea50a-a5f6-4c37-a9cf-258c2aafce7a]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:50 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd Sep 18 23:52:50 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:50 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f" returned: 0 in 0.575s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb378c94-5635-4b46-84dc-cced9203883b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:50 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd" returned: 0 in 0.491s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Path /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 23:52:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:50 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2 Sep 18 23:52:50 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:50 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:52:50 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:51 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.464s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:52:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:51 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f Sep 18 23:52:51 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:52 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f" returned: 0 in 1.134s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:52 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f Sep 18 23:52:52 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:52 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.14b7cc23-6753-400c-807a-4f8c489ea74f" returned: 0 in 0.606s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-14b7cc23-6753-400c-807a-4f8c489ea74f" released by "_delete_snapshot" :: held 2.990s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" released by "delete_snapshot" :: held 3.034s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:52 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:52:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Flow 'volume_create_manager' (21a1be7c-9d90-4da2-996e-1bed8929b153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:52:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f3f98e-6776-4384-907f-3f85ccd9e16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f3f98e-6776-4384-907f-3f85ccd9e16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-10592298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443db7ce-fe7c-4aaa-9fb1-337d2f89610d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4794defbccd4c67a590c04e14a47240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:52:53Z,use_quota=True,user_id='6d1f439fcd284ff3abc639cc7f6f4e86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344fe41e-ed81-45e6-8ebe-1320b7338615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344fe41e-ed81-45e6-8ebe-1320b7338615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff76da1-8090-4e9c-a726-687ea8ed5d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff76da1-8090-4e9c-a726-687ea8ed5d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443db7ce-fe7c-4aaa-9fb1-337d2f89610d', 'volume_name': 'volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f394d19-46a3-4048-8d6d-8a3a49949375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f394d19-46a3-4048-8d6d-8a3a49949375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:52:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c5f1d9-a44a-4538-91ba-5cee88ee2804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:52:53 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Volume 443db7ce-fe7c-4aaa-9fb1-337d2f89610d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d', 'volume_size': 1} Sep 18 23:52:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:53 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Created reservations ['b4b21448-be0c-451d-bf87-4d312757e245', 'b6b95385-29b9-4945-9eaa-b272dbfd8fad', '6ab1abe4-9016-4c7f-934d-e2cf0d6a2637', 'dfdc4b81-4db4-4a36-b889-f588ac454875'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:52:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Delete snapshot completed successfully. Sep 18 23:52:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3345a68b-67c8-4a72-aeaa-88a23a771611 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-14b7cc23-6753-400c-807a-4f8c489ea74f-delete_snapshot" released by "delete_snapshot" :: held 3.534s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:59 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2" returned: 0 in 8.376s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd, size 1024.00 MB, duration 8.38 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:52:59 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Converted 1024.00 MB image at 122.24 MB/s Sep 18 23:52:59 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:59 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2 Sep 18 23:52:59 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:59 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2" returned: 0 in 0.291s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-c65b61ef-9603-440a-9929-859c33a809a2" released by "_copy_volume_from_snapshot" :: held 9.832s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-9283ba2d-7cb6-4e8c-9746-340840f056a0-c65b61ef-9603-440a-9929-859c33a809a2" released by "_create_volume_from_snapshot" :: held 9.927s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.967s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.313s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-10592298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443db7ce-fe7c-4aaa-9fb1-337d2f89610d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4794defbccd4c67a590c04e14a47240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:52:53Z,use_quota=True,user_id='6d1f439fcd284ff3abc639cc7f6f4e86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Creating volume 443db7ce-fe7c-4aaa-9fb1-337d2f89610d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:52:59 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:59 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d 1073741824 Sep 18 23:52:59 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:52:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-22796eac-fa42-44c3-84a1-898996c0217f tempest-GroupSnapshotsTest-617357259 None] Create group from source-snapshot-a920309d-665a-40cd-989e-19fe2bd97f4e completed successfully. Sep 18 23:52:59 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d 1073741824" returned: 0 in 0.482s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:52:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:52:59 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d Sep 18 23:52:59 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:00 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d" returned: 0 in 0.256s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.202s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=116,cinder:INSERT=34,cinder:UPDATE=131,cinder:DELETE=9 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=124,cinder:SELECT=109,cinder:INSERT=29,cinder:DELETE=8 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c5f1d9-a44a-4538-91ba-5cee88ee2804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345808ef-83c0-4623-8ebc-fc9d1e08f38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] Creating offline snapshot 6981c50c-2871-491b-938c-476693c11514 of volume 29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:53:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Volume volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d (443db7ce-fe7c-4aaa-9fb1-337d2f89610d): created successfully Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345808ef-83c0-4623-8ebc-fc9d1e08f38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Flow 'volume_create_manager' (21a1be7c-9d90-4da2-996e-1bed8929b153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d98c80-de19-4037-813e-9962c70e1ff6]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7c7c3971-5e8f-46a0-a88e-350ab8fed140 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Created volume successfully. Sep 18 23:53:00 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:53:00 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-c65b61ef-9603-440a-9929-859c33a809a2" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-c65b61ef-9603-440a-9929-859c33a809a2" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Acquiring lock "cinder-443db7ce-fe7c-4aaa-9fb1-337d2f89610d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d7686-d42d-49d0-b4b7-e66ac8243206]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "cinder-443db7ce-fe7c-4aaa-9fb1-337d2f89610d-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Acquiring lock "cinder-quobyte-443db7ce-fe7c-4aaa-9fb1-337d2f89610d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "cinder-quobyte-443db7ce-fe7c-4aaa-9fb1-337d2f89610d" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:00 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2 Sep 18 23:53:00 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c1554b-3a8f-48c1-a94a-bc98a8453fcb]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:00 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.591s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:53:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:00 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 1G Sep 18 23:53:00 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:00 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d Sep 18 23:53:00 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:01 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2" returned: 0 in 0.503s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:01 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2 Sep 18 23:53:01 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:01 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d" returned: 0 in 0.544s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:01 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d Sep 18 23:53:01 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:01 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 1G" returned: 0 in 0.682s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:01 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c65b61ef-9603-440a-9929-859c33a809a2" returned: 0 in 0.439s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:01 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 Sep 18 23:53:01 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-c65b61ef-9603-440a-9929-859c33a809a2" released by "delete_volume" :: held 1.067s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['a755aeb9-8daf-41d2-b524-6dbe5b27f54d'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:01 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-443db7ce-fe7c-4aaa-9fb1-337d2f89610d" returned: 0 in 0.389s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:01 devstack cinder-volume[85963]: WARNING cinder.quota [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-922360618 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-922360618, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:53:01 devstack cinder-volume[85963]: WARNING cinder.quota [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-922360618 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-922360618, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "cinder-quobyte-443db7ce-fe7c-4aaa-9fb1-337d2f89610d" released by "delete_volume" :: held 1.016s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['9483f6dc-b991-4898-b571-ab8475865a16', 'e8a71c52-be33-4be8-bfd4-1bd78bdb6c26', '891b103d-9f01-4ea2-b56a-c4b84f6db986', 'de2f1664-de30-4ec4-b507-a0be3dcee537'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Created reservations ['3b0c134b-e8fd-4c55-990a-baed17987b0d', '414102a4-e35b-4b64-8761-375f237857a4', '4c6455d1-2b4f-4e79-99b6-8307f6982371', 'f94dde8c-5115-4893-bc82-1e0199fa44ea'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:02 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:53:02 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:02 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:53:02 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:02 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514" returned: 0 in 0.513s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:02 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 is being set with open permissions: ugo+rw Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:02 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 Sep 18 23:53:02 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:02 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.308s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:53:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4fba713b-158a-4052-bbb7-f30ed6748622 tempest-GroupSnapshotsTest-617357259 None] Delete group completed successfully. Sep 18 23:53:02 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.279s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:53:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Deleted volume successfully. Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2c582b42-1511-4d32-83af-1365a97ff4b3 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "cinder-443db7ce-fe7c-4aaa-9fb1-337d2f89610d-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:02 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514" returned: 0 in 0.288s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f66a1ae3-90c1-4335-bf60-c4a40dab2a87 tempest-SnapshotsActionsTest-169566142 None] Create snapshot completed successfully Sep 18 23:53:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] group_snapshot a920309d-665a-40cd-989e-19fe2bd97f4e: deleting Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] group_snapshot a920309d-665a-40cd-989e-19fe2bd97f4e: deleting {{(pid=85963) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-9ec4f053-f48d-4045-ba79-efb46509d9fd" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-9ec4f053-f48d-4045-ba79-efb46509d9fd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-9283ba2d-7cb6-4e8c-9746-340840f056a0" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-9283ba2d-7cb6-4e8c-9746-340840f056a0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Deleting offline snapshot 9283ba2d-7cb6-4e8c-9746-340840f056a0 of volume 9ec4f053-f48d-4045-ba79-efb46509d9fd {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] snapshot_file for this snap is: volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2fafee-8067-4be2-b1ab-59c55c756da8]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:03 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 Sep 18 23:53:03 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Flow 'volume_create_manager' (e679ff92-8380-4623-8119-35338e89632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d5c9a4-44e8-4912-b4bc-5a4415a3faeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d5c9a4-44e8-4912-b4bc-5a4415a3faeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1284166432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e58195-8705-4e06-af0c-4f5a52687d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4794defbccd4c67a590c04e14a47240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:04Z,use_quota=True,user_id='6d1f439fcd284ff3abc639cc7f6f4e86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e94eee4-6e7a-4177-b981-7d425de5d7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e94eee4-6e7a-4177-b981-7d425de5d7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f9d8e8-d327-45bb-a0e5-d318ad72df00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f9d8e8-d327-45bb-a0e5-d318ad72df00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e58195-8705-4e06-af0c-4f5a52687d98', 'volume_name': 'volume-f4e58195-8705-4e06-af0c-4f5a52687d98', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50ab558-3fe4-4c37-9433-681a69d2b0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50ab558-3fe4-4c37-9433-681a69d2b0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618414b7-4dc7-4d12-a2c2-b344ba36cdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Volume f4e58195-8705-4e06-af0c-4f5a52687d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e58195-8705-4e06-af0c-4f5a52687d98', 'volume_size': 1} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1284166432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e58195-8705-4e06-af0c-4f5a52687d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4794defbccd4c67a590c04e14a47240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:04Z,use_quota=True,user_id='6d1f439fcd284ff3abc639cc7f6f4e86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Creating volume f4e58195-8705-4e06-af0c-4f5a52687d98 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:53:03 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f4e58195-8705-4e06-af0c-4f5a52687d98 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Acquiring lock "cinder-6981c50c-2871-491b-938c-476693c11514-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:03 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f4e58195-8705-4e06-af0c-4f5a52687d98 1073741824 Sep 18 23:53:03 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-6981c50c-2871-491b-938c-476693c11514-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Acquiring lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:03 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0" returned: 0 in 0.594s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ec4f053-f48d-4045-ba79-efb46509d9fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" acquired by "delete_snapshot" :: waited 0.062s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Acquiring lock "cinder-quobyte-6981c50c-2871-491b-938c-476693c11514" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[454e366e-5daa-4bb4-b518-243f63f26cdc]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-6981c50c-2871-491b-938c-476693c11514" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Deleting offline snapshot 6981c50c-2871-491b-938c-476693c11514 of volume 29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:53:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] snapshot_file for this snap is: volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c640058-7297-4d1e-9eb8-639d156e409d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:04 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd Sep 18 23:53:04 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:04 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 Sep 18 23:53:04 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:04 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f4e58195-8705-4e06-af0c-4f5a52687d98 1073741824" returned: 0 in 0.697s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:04 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514" returned: 0 in 0.486s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6558228-a70f-493c-bb62-1cc94b3faaf2]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f4e58195-8705-4e06-af0c-4f5a52687d98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:04 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f4e58195-8705-4e06-af0c-4f5a52687d98 Sep 18 23:53:04 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:04 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd" returned: 0 in 0.700s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:04 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 Sep 18 23:53:04 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:04 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:53:04 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:04 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f4e58195-8705-4e06-af0c-4f5a52687d98" returned: 0 in 0.318s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618414b7-4dc7-4d12-a2c2-b344ba36cdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e58195-8705-4e06-af0c-4f5a52687d98', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c4543a-f070-4b15-812a-9bdef433430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:04 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Volume volume-f4e58195-8705-4e06-af0c-4f5a52687d98 (f4e58195-8705-4e06-af0c-4f5a52687d98): created successfully Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c4543a-f070-4b15-812a-9bdef433430e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Flow 'volume_create_manager' (e679ff92-8380-4623-8119-35338e89632a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5b539ca3-3c62-4172-b893-d15d1b972322 tempest-VolumeQuotasAdminTestJSON-1748233037 None] Created volume successfully. Sep 18 23:53:04 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.447s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:53:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:05 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 Sep 18 23:53:05 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:05 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:05 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0 Sep 18 23:53:05 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:05 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd.9283ba2d-7cb6-4e8c-9746-340840f056a0" returned: 0 in 0.279s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-9283ba2d-7cb6-4e8c-9746-340840f056a0" released by "_delete_snapshot" :: held 2.131s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-9ec4f053-f48d-4045-ba79-efb46509d9fd" released by "delete_snapshot" :: held 2.163s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:05 devstack cinder-volume[85963]: WARNING cinder.quota [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-922360618 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-922360618, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:53:05 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514" returned: 0 in 0.468s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['5595ca62-7c84-4ad0-9071-3c51e5ec1bed', '6db46007-125e-470f-b7fd-8c6d09cfbef3', '5d8dea3a-85b0-4acf-b193-56a04115726c', '20e30591-56a1-4c07-bfc2-4758986da1ee'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:05 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514 Sep 18 23:53:05 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-84560f90-0bc8-48a2-af5e-a5c30a74c310 tempest-GroupSnapshotsTest-617357259 None] group_snapshot a920309d-665a-40cd-989e-19fe2bd97f4e: deleted successfully Sep 18 23:53:05 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.6981c50c-2871-491b-938c-476693c11514" returned: 0 in 0.279s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-6981c50c-2871-491b-938c-476693c11514" released by "_delete_snapshot" :: held 1.834s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" released by "delete_snapshot" :: held 1.888s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Created reservations ['bdcddcf3-e005-42f7-9a85-72467e940d37', '9fa9424f-fc6b-43a0-844d-dc0518451f29', '20634ffa-344a-4c02-b003-ca93860158c6', '4c775314-e1f3-4433-8107-60ad9d53f920'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Delete snapshot completed successfully. Sep 18 23:53:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dfb9ccf2-2617-42e6-94b4-29332df8cf65 tempest-SnapshotsActionsTest-367451747 None] Lock "cinder-6981c50c-2871-491b-938c-476693c11514-delete_snapshot" released by "delete_snapshot" :: held 2.108s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:06 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c08190df-e03d-4368-9331-6f0f198038f5 tempest-VolumeQuotasAdminTestJSON-1929276933 None] Transfer volume completed successfully. Sep 18 23:53:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-9ec4f053-f48d-4045-ba79-efb46509d9fd" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-9ec4f053-f48d-4045-ba79-efb46509d9fd" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edf9031-d398-4173-ab45-b9a97f0f8a26]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:07 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd Sep 18 23:53:07 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Acquiring lock "cinder-f4e58195-8705-4e06-af0c-4f5a52687d98-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Lock "cinder-f4e58195-8705-4e06-af0c-4f5a52687d98-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Acquiring lock "cinder-quobyte-f4e58195-8705-4e06-af0c-4f5a52687d98" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Lock "cinder-quobyte-f4e58195-8705-4e06-af0c-4f5a52687d98" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2283f849-2c08-4f08-a41b-7ee489d15e8a]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f4e58195-8705-4e06-af0c-4f5a52687d98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:07 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f4e58195-8705-4e06-af0c-4f5a52687d98 Sep 18 23:53:07 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:07 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd" returned: 0 in 0.567s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "cinder-3d27257e-b430-48c1-9167-0696f4ff3f95-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:07 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd Sep 18 23:53:07 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Lock "cinder-3d27257e-b430-48c1-9167-0696f4ff3f95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "cinder-quobyte-3d27257e-b430-48c1-9167-0696f4ff3f95" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Lock "cinder-quobyte-3d27257e-b430-48c1-9167-0696f4ff3f95" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Deleting offline snapshot 3d27257e-b430-48c1-9167-0696f4ff3f95 of volume 29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] snapshot_file for this snap is: volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31bf484-933d-4e52-9258-a37c14441af1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:07 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:53:07 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:07 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f4e58195-8705-4e06-af0c-4f5a52687d98" returned: 0 in 0.631s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f4e58195-8705-4e06-af0c-4f5a52687d98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:07 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f4e58195-8705-4e06-af0c-4f5a52687d98 Sep 18 23:53:07 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:08 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ec4f053-f48d-4045-ba79-efb46509d9fd" returned: 0 in 0.634s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-9ec4f053-f48d-4045-ba79-efb46509d9fd" released by "delete_volume" :: held 1.309s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['d925c585-527b-4ad9-b6d0-5e98854877a0'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:08 devstack cinder-volume[85963]: WARNING cinder.db.api [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-922360618'] Sep 18 23:53:08 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.697s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fe397d-c6bf-465a-9481-65b4affa3393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['b214bf30-7fbb-478a-9a2c-295ed39acb78', '1dd40078-4a43-44c0-a127-ca9136cdf527', '5ea9ef1c-3399-40b5-9c33-ea3ffdecd904', '4314bbec-c9b0-40a8-a6ba-5be6cd73b572'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:08 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdb4710-a155-40e7-bf26-58f3f0779c61]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f4e58195-8705-4e06-af0c-4f5a52687d98" returned: 0 in 0.450s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Lock "cinder-quobyte-f4e58195-8705-4e06-af0c-4f5a52687d98" released by "delete_volume" :: held 1.147s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Created reservations ['3e9a2543-351e-4a67-b681-3912cc9c8c4d', '8d5a9a48-4425-4dbe-8106-cbcb0241d210', '25c9f508-e998-4461-8b7d-aa42a7806666', 'b9ea13a6-f132-4b97-b671-4c2d80f45468'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:08 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 Sep 18 23:53:08 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:08 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:53:08 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:08 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:53:08 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:08 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393" returned: 0 in 0.484s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:08 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:53:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-557603b2-8e61-455a-baf6-63683f835c41 tempest-GroupSnapshotsTest-617357259 None] Delete group completed successfully. Sep 18 23:53:08 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.309s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:53:08 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:53:08 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Deleted volume successfully. Sep 18 23:53:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b85f7613-8185-4469-a524-07476a35b5b5 tempest-VolumeQuotasAdminTestJSON-442072288 None] Lock "cinder-f4e58195-8705-4e06-af0c-4f5a52687d98-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:09 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.391s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:09 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95 Sep 18 23:53:09 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:09 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393.3d27257e-b430-48c1-9167-0696f4ff3f95" returned: 0 in 0.319s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Lock "cinder-quobyte-3d27257e-b430-48c1-9167-0696f4ff3f95" released by "_delete_snapshot" :: held 2.062s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" released by "delete_snapshot" :: held 2.090s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:09 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Created reservations ['40f875cd-51ba-4e10-be59-122ad8619449', '479e547c-b825-4289-b48d-0caf71879877', '07b1dd9d-969b-4515-98ba-57fc449f019c', '86e303de-0df3-4c08-b3ab-8308e77db97a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Delete snapshot completed successfully. Sep 18 23:53:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a848d4a5-df77-4b90-a636-e544e97f7e4b tempest-SnapshotsActionsTest-169566142 None] Lock "cinder-3d27257e-b430-48c1-9167-0696f4ff3f95-delete_snapshot" released by "delete_snapshot" :: held 2.367s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cf2ad060-778d-416a-b469-c37be3812124 tempest-GroupSnapshotsTest-617357259 None] Group tempest-GroupSnapshotsTest-Group-411777077: creating Sep 18 23:53:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cf2ad060-778d-416a-b469-c37be3812124 tempest-GroupSnapshotsTest-617357259 None] Group tempest-GroupSnapshotsTest-Group-411777077: created successfully Sep 18 23:53:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cf2ad060-778d-416a-b469-c37be3812124 tempest-GroupSnapshotsTest-617357259 None] Create group completed successfully. Sep 18 23:53:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "cinder-29fe397d-c6bf-465a-9481-65b4affa3393-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Lock "cinder-29fe397d-c6bf-465a-9481-65b4affa3393-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[44213a31-0152-462c-b6e2-e1c0262333b9]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:10 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 Sep 18 23:53:10 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:10 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393" returned: 0 in 0.430s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:10 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393 Sep 18 23:53:10 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:10 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-29fe397d-c6bf-465a-9481-65b4affa3393" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Lock "cinder-quobyte-29fe397d-c6bf-465a-9481-65b4affa3393" released by "delete_volume" :: held 0.818s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:10 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Created reservations ['59ba83ec-f12d-422c-99f3-648557e07e28', '0cad50fe-39d2-497c-bfbf-5d41b8afd40c', '34015538-b87e-4ce9-a746-70ebe48f3cb7', '79106685-7067-412a-93ef-77117a6a26f4'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:11 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:53:11 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:11 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:53:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Deleted volume successfully. Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1300beed-18c0-43b5-8171-5aa7653c8f99 tempest-SnapshotsActionsTest-169566142 None] Lock "cinder-29fe397d-c6bf-465a-9481-65b4affa3393-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Flow 'volume_create_manager' (562175f6-8e20-4d4c-b877-17c1f881f368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8533b36-b799-490b-954c-c7909d2a135a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8533b36-b799-490b-954c-c7909d2a135a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-430717885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51bbc831-2b73-4fed-87df-44861b8b7e87,host='devstack@QuobyteHD#QuobyteHD',id=018eb027-65bf-4fb2-8b3a-18b0a5f287e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec88b46d65574b3bbde675f582502e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:12Z,use_quota=True,user_id='2a7d2e87ac3c4b05a0f1ded8a60056d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b82a282-9129-4c8d-a782-35604ccab32c),volume_type_id=4b82a282-9129-4c8d-a782-35604ccab32c)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e851c907-6df4-4b39-bc04-f6d72c35c08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e851c907-6df4-4b39-bc04-f6d72c35c08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463cf07d-e94f-479c-bfc6-b9ea1dc7c80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463cf07d-e94f-479c-bfc6-b9ea1dc7c80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018eb027-65bf-4fb2-8b3a-18b0a5f287e4', 'volume_name': 'volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9245af72-3d66-4765-89a1-84e8e002663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9245af72-3d66-4765-89a1-84e8e002663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bdf3149-4ea4-4a42-96ec-32da4cd662a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Volume 018eb027-65bf-4fb2-8b3a-18b0a5f287e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4', 'volume_size': 1} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=51bbc831-2b73-4fed-87df-44861b8b7e87,created_at=2026-09-18T21:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-430717885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51bbc831-2b73-4fed-87df-44861b8b7e87,host='devstack@QuobyteHD#QuobyteHD',id=018eb027-65bf-4fb2-8b3a-18b0a5f287e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec88b46d65574b3bbde675f582502e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:12Z,use_quota=True,user_id='2a7d2e87ac3c4b05a0f1ded8a60056d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b82a282-9129-4c8d-a782-35604ccab32c),volume_type_id=4b82a282-9129-4c8d-a782-35604ccab32c)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Creating volume 018eb027-65bf-4fb2-8b3a-18b0a5f287e4 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:53:11 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:53:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:11 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 1073741824 Sep 18 23:53:11 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:12 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 1073741824" returned: 0 in 0.643s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:12 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 Sep 18 23:53:12 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:12 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4" returned: 0 in 0.305s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:53:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bdf3149-4ea4-4a42-96ec-32da4cd662a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dabfd9-b378-4c51-ad18-f71ec190eaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Volume volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 (018eb027-65bf-4fb2-8b3a-18b0a5f287e4): created successfully Sep 18 23:53:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dabfd9-b378-4c51-ad18-f71ec190eaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Flow 'volume_create_manager' (562175f6-8e20-4d4c-b877-17c1f881f368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-53d7c7e7-0275-4de2-a1bc-a8354ed81937 tempest-GroupSnapshotsTest-617357259 None] Created volume successfully. Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Flow 'volume_create_manager' (1799c245-69be-4b87-ac0f-a326e0a7a3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7485d7-994f-40f8-84b1-450b6893a218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7485d7-994f-40f8-84b1-450b6893a218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1286105822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51bbc831-2b73-4fed-87df-44861b8b7e87,host='devstack@QuobyteHD#QuobyteHD',id=b4597f3b-a44b-468e-9306-fa449646da49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec88b46d65574b3bbde675f582502e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:15Z,use_quota=True,user_id='2a7d2e87ac3c4b05a0f1ded8a60056d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b82a282-9129-4c8d-a782-35604ccab32c),volume_type_id=4b82a282-9129-4c8d-a782-35604ccab32c)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98b901c-4fe7-4baa-88c0-b2ca82238063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98b901c-4fe7-4baa-88c0-b2ca82238063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a0fa1b-e75d-4b00-964d-64e78be1abb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a0fa1b-e75d-4b00-964d-64e78be1abb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4597f3b-a44b-468e-9306-fa449646da49', 'volume_name': 'volume-b4597f3b-a44b-468e-9306-fa449646da49', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4350f79-77f5-4dc7-be9d-0835d01bf857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4350f79-77f5-4dc7-be9d-0835d01bf857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ec1f47-c3c5-4b2c-a68e-a5be2fe3d296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:15 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Volume b4597f3b-a44b-468e-9306-fa449646da49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4597f3b-a44b-468e-9306-fa449646da49', 'volume_size': 1} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=51bbc831-2b73-4fed-87df-44861b8b7e87,created_at=2026-09-18T21:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1286105822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51bbc831-2b73-4fed-87df-44861b8b7e87,host='devstack@QuobyteHD#QuobyteHD',id=b4597f3b-a44b-468e-9306-fa449646da49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec88b46d65574b3bbde675f582502e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:15Z,use_quota=True,user_id='2a7d2e87ac3c4b05a0f1ded8a60056d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b82a282-9129-4c8d-a782-35604ccab32c),volume_type_id=4b82a282-9129-4c8d-a782-35604ccab32c)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Creating volume b4597f3b-a44b-468e-9306-fa449646da49 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:53:15 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:15 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 1073741824 Sep 18 23:53:15 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:15 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 1073741824" returned: 0 in 0.676s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:15 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 Sep 18 23:53:15 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:16 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49" returned: 0 in 0.433s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:53:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ec1f47-c3c5-4b2c-a68e-a5be2fe3d296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4597f3b-a44b-468e-9306-fa449646da49', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029421fe-a0ad-463f-a21b-dd8d9e544eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:16 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Volume volume-b4597f3b-a44b-468e-9306-fa449646da49 (b4597f3b-a44b-468e-9306-fa449646da49): created successfully Sep 18 23:53:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029421fe-a0ad-463f-a21b-dd8d9e544eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Flow 'volume_create_manager' (1799c245-69be-4b87-ac0f-a326e0a7a3c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-31315ce3-30f0-4464-96bb-cc084d323a28 tempest-GroupSnapshotsTest-617357259 None] Created volume successfully. Sep 18 23:53:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1e7de39e-1930-4eeb-9f23-0c5f157f84af tempest-GroupSnapshotsTest-617357259 None] Update group completed successfully. Sep 18 23:53:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9bdc0bf8-d009-41e5-a84d-fbcc091cdd0c tempest-GroupSnapshotsTest-617357259 None] Update group completed successfully. Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Flow 'volume_create_manager' (04d3ba73-3dde-4852-a683-55295c158570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3ee57d-30d1-4fb2-b99c-18f144a74dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3ee57d-30d1-4fb2-b99c-18f144a74dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-648471735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a149b38-0ef1-46a9-a9d0-264a29e53962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5ac14d44074a749b5231f2e6478983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:20Z,use_quota=True,user_id='6cc79c9539d14d788855cb64f815aca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6131a7eb-e4d8-4b80-ab38-fa3a527cc0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6131a7eb-e4d8-4b80-ab38-fa3a527cc0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33073c08-c83b-499f-9d4b-c6049234b8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33073c08-c83b-499f-9d4b-c6049234b8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a149b38-0ef1-46a9-a9d0-264a29e53962', 'volume_name': 'volume-6a149b38-0ef1-46a9-a9d0-264a29e53962', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4f0c43-6068-4638-acb9-655445396cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4f0c43-6068-4638-acb9-655445396cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0865b4f-8d9f-4d17-a279-1f114beddee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Volume 6a149b38-0ef1-46a9-a9d0-264a29e53962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a149b38-0ef1-46a9-a9d0-264a29e53962', 'volume_size': 1} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-648471735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a149b38-0ef1-46a9-a9d0-264a29e53962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf5ac14d44074a749b5231f2e6478983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:20Z,use_quota=True,user_id='6cc79c9539d14d788855cb64f815aca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Creating volume 6a149b38-0ef1-46a9-a9d0-264a29e53962 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:53:20 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6a149b38-0ef1-46a9-a9d0-264a29e53962 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:20 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6a149b38-0ef1-46a9-a9d0-264a29e53962 1073741824 Sep 18 23:53:20 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2fcaf96c-35c9-497d-a12a-92608622cdf4 tempest-GroupSnapshotsTest-617357259 None] Update group completed successfully. Sep 18 23:53:20 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6a149b38-0ef1-46a9-a9d0-264a29e53962 1073741824" returned: 0 in 0.557s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6a149b38-0ef1-46a9-a9d0-264a29e53962 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:20 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6a149b38-0ef1-46a9-a9d0-264a29e53962 Sep 18 23:53:20 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:21 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:53:21 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:21 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6a149b38-0ef1-46a9-a9d0-264a29e53962" returned: 0 in 0.453s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Flow 'volume_create_manager' (c23e8217-7af9-4824-a55f-cd1452fbfae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3318ca83-cea9-4df2-8388-1300a4b0a289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0865b4f-8d9f-4d17-a279-1f114beddee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a149b38-0ef1-46a9-a9d0-264a29e53962', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b43643-ead0-46c5-9a88-dd861d2656d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3318ca83-cea9-4df2-8388-1300a4b0a289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1271896407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1be6957-079a-4c10-aa11-c5f58c0b5faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d72829634f49b78819b1105cffe15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:21Z,use_quota=True,user_id='7997381ab6cf4d52a3b94e3e010be4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5abcaa1-6363-4eec-bc02-18864005180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5abcaa1-6363-4eec-bc02-18864005180f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e709a77b-e901-4500-8dc5-62d30d5f068d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:21 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e709a77b-e901-4500-8dc5-62d30d5f068d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1be6957-079a-4c10-aa11-c5f58c0b5faf', 'volume_name': 'volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86ea3da-cb85-4dda-95fc-51dee47b3cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86ea3da-cb85-4dda-95fc-51dee47b3cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3014928b-51e6-414f-92fc-dabbc454a402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Volume d1be6957-079a-4c10-aa11-c5f58c0b5faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf', 'volume_size': 1} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1271896407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1be6957-079a-4c10-aa11-c5f58c0b5faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d72829634f49b78819b1105cffe15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:21Z,use_quota=True,user_id='7997381ab6cf4d52a3b94e3e010be4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Creating volume d1be6957-079a-4c10-aa11-c5f58c0b5faf {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:53:21 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Volume volume-6a149b38-0ef1-46a9-a9d0-264a29e53962 (6a149b38-0ef1-46a9-a9d0-264a29e53962): created successfully Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b43643-ead0-46c5-9a88-dd861d2656d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:21 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf 1073741824 Sep 18 23:53:21 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Flow 'volume_create_manager' (04d3ba73-3dde-4852-a683-55295c158570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.405s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:53:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-084fce0f-eeb8-4e22-a5bf-27ab550f9531 tempest-VolumesServicesTestJSON-413326736 None] Created volume successfully. Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:53:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:53:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-653999d0-5513-4aba-98d0-3dd107d97e80 tempest-GroupSnapshotsTest-617357259 None] Update group completed successfully. Sep 18 23:53:22 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf 1073741824" returned: 0 in 0.592s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:22 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf Sep 18 23:53:22 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Acquiring lock "cinder-6a149b38-0ef1-46a9-a9d0-264a29e53962-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:22 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf" returned: 0 in 0.371s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Lock "cinder-6a149b38-0ef1-46a9-a9d0-264a29e53962-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3014928b-51e6-414f-92fc-dabbc454a402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe278c83-a949-4b15-a059-6d4bddfdaee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Volume volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf (d1be6957-079a-4c10-aa11-c5f58c0b5faf): created successfully Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe278c83-a949-4b15-a059-6d4bddfdaee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Flow 'volume_create_manager' (c23e8217-7af9-4824-a55f-cd1452fbfae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-98175ad2-7431-4798-8c33-91b7ffb3304f tempest-VolumeQuotasNegativeTestJSON-255894657 None] Created volume successfully. Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Acquiring lock "cinder-quobyte-6a149b38-0ef1-46a9-a9d0-264a29e53962" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Lock "cinder-quobyte-6a149b38-0ef1-46a9-a9d0-264a29e53962" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d79c35f-40f1-460a-99da-dcb38318d973]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6a149b38-0ef1-46a9-a9d0-264a29e53962 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:22 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6a149b38-0ef1-46a9-a9d0-264a29e53962 Sep 18 23:53:22 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] GroupSnapshot 23f40ed0-99f7-4e51-a059-5be8682c7e4b: creating. Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Group snapshot 23f40ed0-99f7-4e51-a059-5be8682c7e4b: creating. {{(pid=85963) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Creating offline snapshot 209bdd23-8070-4b30-a492-37e25f58b261 of volume 018eb027-65bf-4fb2-8b3a-18b0a5f287e4 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e5cb25-dda9-4f9a-978a-55c1d0e9a860]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:23 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6a149b38-0ef1-46a9-a9d0-264a29e53962" returned: 0 in 0.454s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6a149b38-0ef1-46a9-a9d0-264a29e53962 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:23 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6a149b38-0ef1-46a9-a9d0-264a29e53962 Sep 18 23:53:23 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:23 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 Sep 18 23:53:23 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:23 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6a149b38-0ef1-46a9-a9d0-264a29e53962" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Lock "cinder-quobyte-6a149b38-0ef1-46a9-a9d0-264a29e53962" released by "delete_volume" :: held 0.784s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Created reservations ['e76acbfb-99d8-46b2-a6c0-0dc7ec39bb56', '17168e19-79d5-42f1-b146-00578fee17d9', '32a02d9d-4209-4eeb-9073-9d1be3326070', 'b2b5cd76-f98c-4da9-b474-9a607cb2f97c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:23 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4" returned: 0 in 0.556s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:23 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:53:23 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:23 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 1G Sep 18 23:53:23 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:24 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:53:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Deleted volume successfully. Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-931b1f6a-ce4a-4f36-8ee3-81fe299c9684 tempest-VolumesServicesTestJSON-413326736 None] Lock "cinder-6a149b38-0ef1-46a9-a9d0-264a29e53962-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:24 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 1G" returned: 0 in 0.691s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:24 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 Sep 18 23:53:24 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Acquiring lock "cinder-d1be6957-079a-4c10-aa11-c5f58c0b5faf-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Lock "cinder-d1be6957-079a-4c10-aa11-c5f58c0b5faf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Acquiring lock "cinder-quobyte-d1be6957-079a-4c10-aa11-c5f58c0b5faf" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Lock "cinder-quobyte-d1be6957-079a-4c10-aa11-c5f58c0b5faf" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa96e16-1792-4cd2-9b11-b453ba2ba56b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:24 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261" returned: 0 in 0.424s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:24 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:53:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:24 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 Sep 18 23:53:24 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:25 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf Sep 18 23:53:25 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:25 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261" returned: 0 in 0.616s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:25 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.info Sep 18 23:53:25 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:25 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf" returned: 0 in 0.926s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:25 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf Sep 18 23:53:25 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:26 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.info" returned: 0 in 0.435s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:26 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:26 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.info Sep 18 23:53:26 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d1be6957-079a-4c10-aa11-c5f58c0b5faf" returned: 0 in 0.486s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:26 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Lock "cinder-quobyte-d1be6957-079a-4c10-aa11-c5f58c0b5faf" released by "delete_volume" :: held 1.498s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Created reservations ['c17735ff-53b5-492f-a7b4-cda8d7b8220b', '33826983-9fb3-4834-83da-bf4addc3a11e', '8f4c4fd7-ff9c-458b-a6ca-044a02cdf4f6', 'b19bff23-70c4-42da-8492-0c9e550a51da'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:26 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:53:26 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:26 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.info" returned: 0 in 0.619s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.494s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Creating offline snapshot 946164d0-e8f0-45d8-a6c1-4829b88501c4 of volume b4597f3b-a44b-468e-9306-fa449646da49 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db74d47-85f3-4c88-a4b9-d5f00fd504e7]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:26 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.347s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:53:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Deleted volume successfully. Sep 18 23:53:26 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 Sep 18 23:53:26 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1ed78bc-be47-4952-9fde-4f70866e79de tempest-VolumeQuotasNegativeTestJSON-255894657 None] Lock "cinder-d1be6957-079a-4c10-aa11-c5f58c0b5faf-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:27 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49" returned: 0 in 0.799s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:27 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 1G Sep 18 23:53:27 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:28 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 1G" returned: 0 in 0.677s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4597f3b-a44b-468e-9306-fa449646da49 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:28 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4597f3b-a44b-468e-9306-fa449646da49 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 Sep 18 23:53:28 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:28 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4597f3b-a44b-468e-9306-fa449646da49 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4" returned: 0 in 0.458s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:28 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:53:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:28 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 Sep 18 23:53:28 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:29 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4" returned: 0 in 0.359s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:29 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.info Sep 18 23:53:29 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:29 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.info" returned: 0 in 0.417s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:29 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:53:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:29 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.info Sep 18 23:53:29 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:30 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.info" returned: 0 in 0.565s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.441s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-747b82d3-d76c-4a06-a1ec-9563a94fdbd3 tempest-GroupSnapshotsTest-617357259 None] group_snapshot 23f40ed0-99f7-4e51-a059-5be8682c7e4b: created successfully Sep 18 23:53:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] group_snapshot 23f40ed0-99f7-4e51-a059-5be8682c7e4b: deleting Sep 18 23:53:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] group_snapshot 23f40ed0-99f7-4e51-a059-5be8682c7e4b: deleting {{(pid=85963) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 18 23:53:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-018eb027-65bf-4fb2-8b3a-18b0a5f287e4" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-018eb027-65bf-4fb2-8b3a-18b0a5f287e4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-209bdd23-8070-4b30-a492-37e25f58b261" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-209bdd23-8070-4b30-a492-37e25f58b261" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Deleting offline snapshot 209bdd23-8070-4b30-a492-37e25f58b261 of volume 018eb027-65bf-4fb2-8b3a-18b0a5f287e4 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:53:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] snapshot_file for this snap is: volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:53:31 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e79609-37dd-421d-9909-7a4159112c38]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:31 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 Sep 18 23:53:31 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:32 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261" returned: 0 in 0.783s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:53:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a338f1b-ce88-4798-b5d6-159bb7ada819]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:32 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 Sep 18 23:53:32 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:32 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4" returned: 0 in 0.847s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:33 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 Sep 18 23:53:33 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:33 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261" returned: 0 in 0.516s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:33 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261 Sep 18 23:53:33 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:33 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4.209bdd23-8070-4b30-a492-37e25f58b261" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-209bdd23-8070-4b30-a492-37e25f58b261" released by "_delete_snapshot" :: held 2.720s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-018eb027-65bf-4fb2-8b3a-18b0a5f287e4" released by "delete_snapshot" :: held 2.765s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-b4597f3b-a44b-468e-9306-fa449646da49" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-b4597f3b-a44b-468e-9306-fa449646da49" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-946164d0-e8f0-45d8-a6c1-4829b88501c4" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-946164d0-e8f0-45d8-a6c1-4829b88501c4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Deleting offline snapshot 946164d0-e8f0-45d8-a6c1-4829b88501c4 of volume b4597f3b-a44b-468e-9306-fa449646da49 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:53:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] snapshot_file for this snap is: volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:53:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2ce839-e679-4a9d-b0ec-6f818f90f3e3]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:34 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 Sep 18 23:53:34 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:34 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4" returned: 0 in 0.461s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4597f3b-a44b-468e-9306-fa449646da49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:53:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5026303f-1a61-424a-a2b9-85a51160c87b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:34 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 Sep 18 23:53:34 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:34 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49" returned: 0 in 0.459s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:35 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 Sep 18 23:53:35 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:35 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4" returned: 0 in 0.443s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:35 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4 Sep 18 23:53:35 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:35 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49.946164d0-e8f0-45d8-a6c1-4829b88501c4" returned: 0 in 0.420s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-946164d0-e8f0-45d8-a6c1-4829b88501c4" released by "_delete_snapshot" :: held 1.926s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-b4597f3b-a44b-468e-9306-fa449646da49" released by "delete_snapshot" :: held 1.963s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:36 devstack cinder-volume[85963]: WARNING cinder.quota [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2020786217 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2020786217, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:53:36 devstack cinder-volume[85963]: WARNING cinder.quota [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2020786217 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2020786217, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:53:36 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['3e697f28-fcc9-4907-bccf-371169ca2c4b', '82b07732-9dfb-4876-987a-f33ea6217c0a', 'd9824e07-c979-4059-b9fe-fb80e586fa57', '871ada68-cd7e-4816-b74f-8389896edc20'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:36 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['68d3d390-fa3f-49a9-aaa5-1a86c3c396b4', 'bda40993-d6ff-4dd0-abc7-e174b017b0f1', 'd0a600f9-7393-4a7b-a1e7-eea24199d2f8', '3347b8fe-f3b8-49b6-b793-5061918a2505'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f9b84018-5f43-48f7-80b8-d9afc8c8b166 tempest-GroupSnapshotsTest-617357259 None] group_snapshot 23f40ed0-99f7-4e51-a059-5be8682c7e4b: deleted successfully Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Flow 'volume_create_manager' (c0d64670-b1a0-4fec-9100-1f3c7b15a86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb37028-d8ca-45a9-bd7e-03d82934857a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb37028-d8ca-45a9-bd7e-03d82934857a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-649137160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40214bcd-353f-443a-9206-7b1542b7d085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a445ce4ce8b454fb360f791f8640175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:37Z,use_quota=True,user_id='44a12633fa364a38abb4a82a6c2a7564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df65acec-3af2-4a99-b395-f496ce5653ca),volume_type_id=df65acec-3af2-4a99-b395-f496ce5653ca)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5356b914-9277-4ffb-ae53-61ab84f45781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5356b914-9277-4ffb-ae53-61ab84f45781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966c53b9-ccf0-4b80-a0dc-8620523f63d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966c53b9-ccf0-4b80-a0dc-8620523f63d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40214bcd-353f-443a-9206-7b1542b7d085', 'volume_name': 'volume-40214bcd-353f-443a-9206-7b1542b7d085', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6453e79f-06eb-4679-a264-6455509eddd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6453e79f-06eb-4679-a264-6455509eddd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c847c627-9571-44f9-920a-0da5dcab3335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:37 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Volume 40214bcd-353f-443a-9206-7b1542b7d085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40214bcd-353f-443a-9206-7b1542b7d085', 'volume_size': 1} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-649137160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40214bcd-353f-443a-9206-7b1542b7d085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a445ce4ce8b454fb360f791f8640175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:37Z,use_quota=True,user_id='44a12633fa364a38abb4a82a6c2a7564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df65acec-3af2-4a99-b395-f496ce5653ca),volume_type_id=df65acec-3af2-4a99-b395-f496ce5653ca)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Creating volume 40214bcd-353f-443a-9206-7b1542b7d085 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:53:37 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40214bcd-353f-443a-9206-7b1542b7d085 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:37 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40214bcd-353f-443a-9206-7b1542b7d085 1073741824 Sep 18 23:53:37 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-018eb027-65bf-4fb2-8b3a-18b0a5f287e4" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-018eb027-65bf-4fb2-8b3a-18b0a5f287e4" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0dff65-8eca-47e0-8934-2196f04573e1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:37 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 Sep 18 23:53:37 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:38 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40214bcd-353f-443a-9206-7b1542b7d085 1073741824" returned: 0 in 0.702s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40214bcd-353f-443a-9206-7b1542b7d085 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:38 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:38 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40214bcd-353f-443a-9206-7b1542b7d085 Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4" returned: 0 in 0.449s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:38 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:38 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4 Sep 18 23:53:38 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:38 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-018eb027-65bf-4fb2-8b3a-18b0a5f287e4" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-018eb027-65bf-4fb2-8b3a-18b0a5f287e4" released by "delete_volume" :: held 0.881s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-b4597f3b-a44b-468e-9306-fa449646da49" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:38 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40214bcd-353f-443a-9206-7b1542b7d085" returned: 0 in 0.403s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-b4597f3b-a44b-468e-9306-fa449646da49" acquired by "delete_volume" :: waited 0.059s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c847c627-9571-44f9-920a-0da5dcab3335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40214bcd-353f-443a-9206-7b1542b7d085', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3bf2cd-234c-402f-959b-cb217a91d433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09520f1-9b4b-4a00-9266-b6e1a3a6a98f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:38 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Volume volume-40214bcd-353f-443a-9206-7b1542b7d085 (40214bcd-353f-443a-9206-7b1542b7d085): created successfully Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3bf2cd-234c-402f-959b-cb217a91d433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Flow 'volume_create_manager' (c0d64670-b1a0-4fec-9100-1f3c7b15a86c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-18f26019-c37d-4b26-a050-39a6561a7bc3 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Created volume successfully. Sep 18 23:53:38 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 Sep 18 23:53:38 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:39 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49" returned: 0 in 0.521s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:39 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49 Sep 18 23:53:39 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:39 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b4597f3b-a44b-468e-9306-fa449646da49" returned: 0 in 0.381s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-b4597f3b-a44b-468e-9306-fa449646da49" released by "delete_volume" :: held 0.989s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['fcfe8d90-91e4-44a3-9950-7afdca67a545'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:39 devstack cinder-volume[85963]: WARNING cinder.quota [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2020786217 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2020786217, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['2e62fad8-7fc0-4acc-925a-2ada2f6b7bdd', 'fb54379d-6c8c-4c4a-8ef2-6ce009dcf650', 'bd160914-9cac-401a-bd9e-a52e7adda93c', '46553cf0-f51a-4dfd-927e-2c4103a79373'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18a0f239-f819-4fa4-a1e0-76078bc0c512 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18a0f239-f819-4fa4-a1e0-76078bc0c512 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18a0f239-f819-4fa4-a1e0-76078bc0c512 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18a0f239-f819-4fa4-a1e0-76078bc0c512 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18a0f239-f819-4fa4-a1e0-76078bc0c512 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18a0f239-f819-4fa4-a1e0-76078bc0c512 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:39 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:53:39 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:39 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['d571a4d9-1cdb-4eef-a1b0-3523694f3023', '9a141c6b-d324-4008-b521-a6988e160bd2', 'e22a3ed9-74d0-4b57-b589-c2cd158c72f5', 'd8a8add2-3b60-4fb2-8ff9-9295cf74f6dd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:40 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:53:40 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:40 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18a0f239-f819-4fa4-a1e0-76078bc0c512 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.273s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:40 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-18a0f239-f819-4fa4-a1e0-76078bc0c512 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:53:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-18a0f239-f819-4fa4-a1e0-76078bc0c512 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Retype volume completed successfully. Sep 18 23:53:40 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.256s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:40 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:53:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-179e7dd9-1f69-4990-bfd4-559736d3b522 tempest-GroupSnapshotsTest-617357259 None] Delete group completed successfully. Sep 18 23:53:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Acquiring lock "cinder-40214bcd-353f-443a-9206-7b1542b7d085-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Lock "cinder-40214bcd-353f-443a-9206-7b1542b7d085-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Acquiring lock "cinder-quobyte-40214bcd-353f-443a-9206-7b1542b7d085" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Lock "cinder-quobyte-40214bcd-353f-443a-9206-7b1542b7d085" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1266289a-54b9-429d-8d21-f8e1b21367ef]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40214bcd-353f-443a-9206-7b1542b7d085 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:41 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40214bcd-353f-443a-9206-7b1542b7d085 Sep 18 23:53:41 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a2f4e338-ed93-4ba2-9d2d-7d9d6a3dd394 tempest-GroupSnapshotsTest-617357259 None] Group tempest-GroupSnapshotsTest-Group-575334603: creating Sep 18 23:53:41 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a2f4e338-ed93-4ba2-9d2d-7d9d6a3dd394 tempest-GroupSnapshotsTest-617357259 None] Group tempest-GroupSnapshotsTest-Group-575334603: created successfully Sep 18 23:53:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40214bcd-353f-443a-9206-7b1542b7d085" returned: 0 in 0.440s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40214bcd-353f-443a-9206-7b1542b7d085 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a2f4e338-ed93-4ba2-9d2d-7d9d6a3dd394 tempest-GroupSnapshotsTest-617357259 None] Create group completed successfully. Sep 18 23:53:41 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40214bcd-353f-443a-9206-7b1542b7d085 Sep 18 23:53:41 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:41 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40214bcd-353f-443a-9206-7b1542b7d085" returned: 0 in 0.271s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Lock "cinder-quobyte-40214bcd-353f-443a-9206-7b1542b7d085" released by "delete_volume" :: held 0.769s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:41 devstack cinder-volume[85963]: WARNING cinder.quota [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:53:41 devstack cinder-volume[85963]: WARNING cinder.quota [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:53:41 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Created reservations ['9d5e2451-b353-43de-ae0d-72728d52272a', '7486defc-f039-4c0f-8b0d-d998df699cc3', '63fb8d7a-87e1-4ce2-a023-c0063a606d74', '0fac3d26-e7b9-412e-af24-b68aefe5bce8'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:42 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:53:42 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:42 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:42 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:53:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Deleted volume successfully. Sep 18 23:53:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd6b0a1d-ed4c-4be6-8de8-655967de4936 tempest-VolumeRetypeWithoutMigrationTest-903447530 None] Lock "cinder-40214bcd-353f-443a-9206-7b1542b7d085-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Flow 'volume_create_manager' (7ce252cb-e9cb-4aa5-ae9a-d3558e6467ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a83fd5-a9e5-40e1-a9e4-8b242d68c50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a83fd5-a9e5-40e1-a9e4-8b242d68c50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-728616189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c148d264-b74e-4d74-8384-4f6e7d7bdc1a,host='devstack@QuobyteHD#QuobyteHD',id=9d2093f9-7e09-44c2-af35-c5194086ca9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec88b46d65574b3bbde675f582502e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:43Z,use_quota=True,user_id='2a7d2e87ac3c4b05a0f1ded8a60056d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90cb9d09-0781-4d4b-a272-6876a0c5125d),volume_type_id=90cb9d09-0781-4d4b-a272-6876a0c5125d)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa31406-844e-4a38-b303-8840c096e7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa31406-844e-4a38-b303-8840c096e7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602081e1-aa11-4ea1-be45-9d9cb00c5ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602081e1-aa11-4ea1-be45-9d9cb00c5ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2093f9-7e09-44c2-af35-c5194086ca9c', 'volume_name': 'volume-9d2093f9-7e09-44c2-af35-c5194086ca9c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f9ebe7-c5d6-4fec-931b-4938a0069e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f9ebe7-c5d6-4fec-931b-4938a0069e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b46a5b-e381-499a-9728-59823a29098c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Volume 9d2093f9-7e09-44c2-af35-c5194086ca9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2093f9-7e09-44c2-af35-c5194086ca9c', 'volume_size': 1} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c148d264-b74e-4d74-8384-4f6e7d7bdc1a,created_at=2026-09-18T21:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-728616189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c148d264-b74e-4d74-8384-4f6e7d7bdc1a,host='devstack@QuobyteHD#QuobyteHD',id=9d2093f9-7e09-44c2-af35-c5194086ca9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec88b46d65574b3bbde675f582502e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:43Z,use_quota=True,user_id='2a7d2e87ac3c4b05a0f1ded8a60056d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90cb9d09-0781-4d4b-a272-6876a0c5125d),volume_type_id=90cb9d09-0781-4d4b-a272-6876a0c5125d)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Creating volume 9d2093f9-7e09-44c2-af35-c5194086ca9c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:53:43 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:43 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c 1073741824 Sep 18 23:53:43 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:43 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c 1073741824" returned: 0 in 0.539s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:44 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c Sep 18 23:53:44 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:44 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c" returned: 0 in 0.291s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b46a5b-e381-499a-9728-59823a29098c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2093f9-7e09-44c2-af35-c5194086ca9c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2819a4c4-67a7-41b3-ab8b-95c5aec33e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:44 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Volume volume-9d2093f9-7e09-44c2-af35-c5194086ca9c (9d2093f9-7e09-44c2-af35-c5194086ca9c): created successfully Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2819a4c4-67a7-41b3-ab8b-95c5aec33e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Flow 'volume_create_manager' (7ce252cb-e9cb-4aa5-ae9a-d3558e6467ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-23c38d0a-ed2f-47df-b45c-7e872b502947 tempest-GroupSnapshotsTest-617357259 None] Created volume successfully. Sep 18 23:53:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] GroupSnapshot 14c3fbc8-8ce1-40a3-b9c2-3b6b2ca06f22: creating. Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] Group snapshot 14c3fbc8-8ce1-40a3-b9c2-3b6b2ca06f22: creating. {{(pid=85963) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] Creating offline snapshot b4301808-f82e-431e-9ee7-22dfeffa1437 of volume 9d2093f9-7e09-44c2-af35-c5194086ca9c {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2a2352-7c99-4ea8-898f-3284751429b4]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:45 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c Sep 18 23:53:45 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:45 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c" returned: 0 in 0.441s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:45 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 1G Sep 18 23:53:45 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:45 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 1G" returned: 0 in 0.504s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2093f9-7e09-44c2-af35-c5194086ca9c -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:45 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2093f9-7e09-44c2-af35-c5194086ca9c -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 Sep 18 23:53:45 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:46 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2093f9-7e09-44c2-af35-c5194086ca9c -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437" returned: 0 in 0.340s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:46 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:53:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:46 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 Sep 18 23:53:46 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:46 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437" returned: 0 in 0.320s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:46 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.info Sep 18 23:53:46 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:47 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.info" returned: 0 in 0.403s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:47 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 23:53:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:47 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.info Sep 18 23:53:47 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:47 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.info" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.461s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2a88b90a-6c26-48f3-bfe3-bd7db6a1bda9 tempest-GroupSnapshotsTest-617357259 None] group_snapshot 14c3fbc8-8ce1-40a3-b9c2-3b6b2ca06f22: created successfully Sep 18 23:53:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] group_snapshot 14c3fbc8-8ce1-40a3-b9c2-3b6b2ca06f22: deleting Sep 18 23:53:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] group_snapshot 14c3fbc8-8ce1-40a3-b9c2-3b6b2ca06f22: deleting {{(pid=85963) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 18 23:53:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-9d2093f9-7e09-44c2-af35-c5194086ca9c" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-9d2093f9-7e09-44c2-af35-c5194086ca9c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-b4301808-f82e-431e-9ee7-22dfeffa1437" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-b4301808-f82e-431e-9ee7-22dfeffa1437" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Deleting offline snapshot b4301808-f82e-431e-9ee7-22dfeffa1437 of volume 9d2093f9-7e09-44c2-af35-c5194086ca9c {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:53:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] snapshot_file for this snap is: volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:53:48 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73dbcf4-61e1-4bea-8cca-ad3d8177b2bf]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:48 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 Sep 18 23:53:48 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:48 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437" returned: 0 in 0.469s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d2093f9-7e09-44c2-af35-c5194086ca9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:53:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cf377c-0971-4669-8cf6-6d62fc7eaf57]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:49 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c Sep 18 23:53:49 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:49 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c" returned: 0 in 0.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:49 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 Sep 18 23:53:49 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:49 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437" returned: 0 in 0.431s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:49 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437 Sep 18 23:53:49 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:50 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c.b4301808-f82e-431e-9ee7-22dfeffa1437" returned: 0 in 0.335s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-b4301808-f82e-431e-9ee7-22dfeffa1437" released by "_delete_snapshot" :: held 1.819s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-9d2093f9-7e09-44c2-af35-c5194086ca9c" released by "delete_snapshot" :: held 1.849s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:50 devstack cinder-volume[85963]: WARNING cinder.quota [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1233535401 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1233535401, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:53:50 devstack cinder-volume[85963]: WARNING cinder.quota [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1233535401 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1233535401, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['e9bf4261-41b7-43e8-812e-996292655b17', '6d448cb2-de0a-4cbb-8507-7de3a10accd5', '3a49cb31-305b-4f58-b8eb-7b3d42057cb9', '47d49b18-3a70-4371-8cc7-6b69b6d9a5d4'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:50 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9dfc5fa0-c347-464b-8d0a-fe7ca335eda7 tempest-GroupSnapshotsTest-617357259 None] group_snapshot 14c3fbc8-8ce1-40a3-b9c2-3b6b2ca06f22: deleted successfully Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Flow 'volume_create_manager' (5e27c875-6067-46fc-863e-5638261bd4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fd97f6-bf6b-4cfd-ac66-4872695ad3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fd97f6-bf6b-4cfd-ac66-4872695ad3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-274373630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa93252-ce45-46d8-bae5-e0cb386510e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0768c39d6b4cc399164c0a38454980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:50Z,use_quota=True,user_id='6494c2dbadb94dbfb13b6f2cd4d560e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6873d99-8ad5-4a98-9dd6-f9d55e697b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6873d99-8ad5-4a98-9dd6-f9d55e697b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e4317d-0195-42e9-a948-fab7356ad4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e4317d-0195-42e9-a948-fab7356ad4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa93252-ce45-46d8-bae5-e0cb386510e5', 'volume_name': 'volume-2aa93252-ce45-46d8-bae5-e0cb386510e5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df37d2c-e454-487e-8c6f-bede3a59b129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df37d2c-e454-487e-8c6f-bede3a59b129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d86e163-b244-4409-a537-88b5a7679008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:50 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Volume 2aa93252-ce45-46d8-bae5-e0cb386510e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa93252-ce45-46d8-bae5-e0cb386510e5', 'volume_size': 1} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-274373630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa93252-ce45-46d8-bae5-e0cb386510e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0768c39d6b4cc399164c0a38454980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:50Z,use_quota=True,user_id='6494c2dbadb94dbfb13b6f2cd4d560e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Creating volume 2aa93252-ce45-46d8-bae5-e0cb386510e5 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:53:50 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:53:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:50 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 1073741824 Sep 18 23:53:50 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:51 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 1073741824" returned: 0 in 0.602s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "cinder-quobyte-9d2093f9-7e09-44c2-af35-c5194086ca9c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-9d2093f9-7e09-44c2-af35-c5194086ca9c" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b6f494-56f7-4997-ad11-c9ee8fdb1935]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:51 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 Sep 18 23:53:51 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:51 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c Sep 18 23:53:51 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:51 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d86e163-b244-4409-a537-88b5a7679008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa93252-ce45-46d8-bae5-e0cb386510e5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edd65a6-8229-47ce-af8d-c429857ae364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:51 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Volume volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 (2aa93252-ce45-46d8-bae5-e0cb386510e5): created successfully Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edd65a6-8229-47ce-af8d-c429857ae364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Flow 'volume_create_manager' (5e27c875-6067-46fc-863e-5638261bd4da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-03043583-5099-4ba2-a9f4-d15c6f13b48f tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Created volume successfully. Sep 18 23:53:51 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c" returned: 0 in 0.485s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:51 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c Sep 18 23:53:51 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:52 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9d2093f9-7e09-44c2-af35-c5194086ca9c" returned: 0 in 0.293s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Lock "cinder-quobyte-9d2093f9-7e09-44c2-af35-c5194086ca9c" released by "delete_volume" :: held 0.861s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['32605e64-9ee1-4ca4-98c5-2b9284fd2908'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Flow 'volume_create_manager' (54b51e1f-9f4b-4dfd-a7bc-e71d913fd873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b82707-9540-4096-9372-8476c07bbda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b82707-9540-4096-9372-8476c07bbda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-89663473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81dcf61d-3eb1-4167-bdde-74d32438b875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1407f46e964f348193a904fb89d5c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:52Z,use_quota=True,user_id='df58e9a011de4a7f8c8302c030eddd70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068d75c6-a93b-40c9-83a8-6584457ba727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068d75c6-a93b-40c9-83a8-6584457ba727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d2cd14-36b0-43af-bec0-c53aab96ab3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d2cd14-36b0-43af-bec0-c53aab96ab3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81dcf61d-3eb1-4167-bdde-74d32438b875', 'volume_name': 'volume-81dcf61d-3eb1-4167-bdde-74d32438b875', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0f6e71-5cf7-45c1-a814-25ca6bdb2132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0f6e71-5cf7-45c1-a814-25ca6bdb2132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985ee8f8-ef1d-4455-bfd9-5bcf48481469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:52 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Volume 81dcf61d-3eb1-4167-bdde-74d32438b875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81dcf61d-3eb1-4167-bdde-74d32438b875', 'volume_size': 1} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-89663473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81dcf61d-3eb1-4167-bdde-74d32438b875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1407f46e964f348193a904fb89d5c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:52Z,use_quota=True,user_id='df58e9a011de4a7f8c8302c030eddd70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Creating volume 81dcf61d-3eb1-4167-bdde-74d32438b875 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:53:52 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-81dcf61d-3eb1-4167-bdde-74d32438b875 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:52 devstack cinder-volume[85963]: WARNING cinder.quota [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1233535401 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1233535401, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:53:52 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-81dcf61d-3eb1-4167-bdde-74d32438b875 1073741824 Sep 18 23:53:52 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Created reservations ['0302292b-4f8f-4099-b141-672d960d761e', '70f4d342-4472-4884-9f8f-99432d511794', 'b42b4343-d533-49b4-84e7-61730b6120ad', '72db1ca3-13b5-4798-828f-e484d7c5d3fd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:52 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:53:52 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:52 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.332s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:53:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5528cda5-e55c-459b-8fa1-ead3adb93da7 tempest-GroupSnapshotsTest-617357259 None] Delete group completed successfully. Sep 18 23:53:52 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-81dcf61d-3eb1-4167-bdde-74d32438b875 1073741824" returned: 0 in 0.558s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-81dcf61d-3eb1-4167-bdde-74d32438b875 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:52 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-81dcf61d-3eb1-4167-bdde-74d32438b875 Sep 18 23:53:52 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:53 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-81dcf61d-3eb1-4167-bdde-74d32438b875" returned: 0 in 0.253s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.267s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985ee8f8-ef1d-4455-bfd9-5bcf48481469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81dcf61d-3eb1-4167-bdde-74d32438b875', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd3005e-1a74-42fe-9abc-63ad50ac1457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Creating offline snapshot 4c577504-0b6b-44bb-88c5-7757aa849604 of volume 2aa93252-ce45-46d8-bae5-e0cb386510e5 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:53:53 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Volume volume-81dcf61d-3eb1-4167-bdde-74d32438b875 (81dcf61d-3eb1-4167-bdde-74d32438b875): created successfully Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd3005e-1a74-42fe-9abc-63ad50ac1457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Flow 'volume_create_manager' (54b51e1f-9f4b-4dfd-a7bc-e71d913fd873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d2fea0-f5f7-4318-ad2e-e41293ff40bd]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-48cd5480-18c7-4048-9a51-a89b97bd05a5 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Created volume successfully. Sep 18 23:53:53 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 Sep 18 23:53:53 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:53 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5" returned: 0 in 0.431s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:53 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 1G Sep 18 23:53:53 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:54 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 1G" returned: 0 in 0.478s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:54 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 Sep 18 23:53:54 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:54 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604" returned: 0 in 0.383s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:54 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 is being set with open permissions: ugo+rw Sep 18 23:53:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:54 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 Sep 18 23:53:54 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:54 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604" returned: 0 in 0.332s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:55 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.info Sep 18 23:53:55 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:55 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.info" returned: 0 in 0.379s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:55 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.info is being set with open permissions: ugo+rw Sep 18 23:53:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:55 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.info Sep 18 23:53:55 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c281708f-7d57-4bf6-b5b3-c45113f88977 req-3237b618-6222-49ad-91c4-64a2cd817201 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:55 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.info" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c281708f-7d57-4bf6-b5b3-c45113f88977 req-3237b618-6222-49ad-91c4-64a2cd817201 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.273s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c281708f-7d57-4bf6-b5b3-c45113f88977 req-3237b618-6222-49ad-91c4-64a2cd817201 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6c1e0a60-1eea-4261-bfc0-c9a213dfdec9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Create snapshot completed successfully Sep 18 23:53:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-c281708f-7d57-4bf6-b5b3-c45113f88977 req-3237b618-6222-49ad-91c4-64a2cd817201 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-81dcf61d-3eb1-4167-bdde-74d32438b875', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f964ac86-6a6f-4b74-967b-9576cf2bae11', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:53:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-c281708f-7d57-4bf6-b5b3-c45113f88977 req-3237b618-6222-49ad-91c4-64a2cd817201 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] attachment_update completed successfully. Sep 18 23:53:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Acquiring lock "cinder-4c577504-0b6b-44bb-88c5-7757aa849604-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "cinder-4c577504-0b6b-44bb-88c5-7757aa849604-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Acquiring lock "cinder-quobyte-2aa93252-ce45-46d8-bae5-e0cb386510e5" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "cinder-quobyte-2aa93252-ce45-46d8-bae5-e0cb386510e5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Acquiring lock "cinder-quobyte-4c577504-0b6b-44bb-88c5-7757aa849604" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "cinder-quobyte-4c577504-0b6b-44bb-88c5-7757aa849604" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Deleting offline snapshot 4c577504-0b6b-44bb-88c5-7757aa849604 of volume 2aa93252-ce45-46d8-bae5-e0cb386510e5 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:53:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] snapshot_file for this snap is: volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:53:56 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[250e4c5c-4575-4966-826d-5af6480c5f9e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:57 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 Sep 18 23:53:57 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:57 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604" returned: 0 in 0.473s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aa93252-ce45-46d8-bae5-e0cb386510e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:53:57 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74b5ddf-449e-429c-9752-d905f1f6a77f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:57 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 Sep 18 23:53:57 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:57 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5" returned: 0 in 0.426s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:57 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 Sep 18 23:53:57 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:53:58 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Flow 'volume_create_manager' (2a583822-5bf1-478a-977c-9b3c194458ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e79e3f4-907a-430b-8b11-844e8aa0b207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604" returned: 0 in 0.537s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e79e3f4-907a-430b-8b11-844e8aa0b207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-668897481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f0727a-3a37-407e-8ac2-510dfece015f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbaf55f9b0794d81bcecc857417d1233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:58Z,use_quota=True,user_id='59141bb491674138830e0c29122075b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4065408f-213c-406d-81a2-a196c3a04f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4065408f-213c-406d-81a2-a196c3a04f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:58 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604 Sep 18 23:53:58 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12c1883-e330-4af4-94d5-0922bdbe2b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12c1883-e330-4af4-94d5-0922bdbe2b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f0727a-3a37-407e-8ac2-510dfece015f', 'volume_name': 'volume-a6f0727a-3a37-407e-8ac2-510dfece015f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69e266b-158b-4bdd-9386-0d462801ead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69e266b-158b-4bdd-9386-0d462801ead4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51c93cf-a193-4b1d-bb34-6caf2120d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Volume a6f0727a-3a37-407e-8ac2-510dfece015f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f0727a-3a37-407e-8ac2-510dfece015f', 'volume_size': 1} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-668897481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f0727a-3a37-407e-8ac2-510dfece015f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbaf55f9b0794d81bcecc857417d1233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:53:58Z,use_quota=True,user_id='59141bb491674138830e0c29122075b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Creating volume a6f0727a-3a37-407e-8ac2-510dfece015f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:53:58 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a6f0727a-3a37-407e-8ac2-510dfece015f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:58 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a6f0727a-3a37-407e-8ac2-510dfece015f 1073741824 Sep 18 23:53:58 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:58 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5.4c577504-0b6b-44bb-88c5-7757aa849604" returned: 0 in 0.310s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "cinder-quobyte-4c577504-0b6b-44bb-88c5-7757aa849604" released by "_delete_snapshot" :: held 1.914s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "cinder-quobyte-2aa93252-ce45-46d8-bae5-e0cb386510e5" released by "delete_snapshot" :: held 1.952s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Created reservations ['aebd8394-8a9d-4ae1-ad73-cb06466634d6', 'e893f60d-6eba-428b-846b-a1e5c55f8559', '7b149d43-374b-445d-93de-2b61c65f4784', '1735b501-c84e-49e1-b75b-e4d39ff88004'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:53:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Delete snapshot completed successfully. Sep 18 23:53:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-36bcec44-3ae2-437e-a227-b1ae0233f643 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "cinder-4c577504-0b6b-44bb-88c5-7757aa849604-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:53:59 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a6f0727a-3a37-407e-8ac2-510dfece015f 1073741824" returned: 0 in 0.552s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a6f0727a-3a37-407e-8ac2-510dfece015f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:59 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a6f0727a-3a37-407e-8ac2-510dfece015f Sep 18 23:53:59 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Acquiring lock "cinder-2aa93252-ce45-46d8-bae5-e0cb386510e5-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "cinder-2aa93252-ce45-46d8-bae5-e0cb386510e5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Acquiring lock "cinder-quobyte-2aa93252-ce45-46d8-bae5-e0cb386510e5" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "cinder-quobyte-2aa93252-ce45-46d8-bae5-e0cb386510e5" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:53:59 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a6f0727a-3a37-407e-8ac2-510dfece015f" returned: 0 in 0.427s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51c93cf-a193-4b1d-bb34-6caf2120d019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f0727a-3a37-407e-8ac2-510dfece015f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e7691e-1090-4a25-8eb2-2436f6ec619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[697f79c0-5400-4470-8ed4-9d6cc275abc1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:53:59 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Volume volume-a6f0727a-3a37-407e-8ac2-510dfece015f (a6f0727a-3a37-407e-8ac2-510dfece015f): created successfully Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e7691e-1090-4a25-8eb2-2436f6ec619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Flow 'volume_create_manager' (2a583822-5bf1-478a-977c-9b3c194458ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:53:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-bbe4b9c8-4064-4cb5-a22b-954478182703 tempest-AbsoluteLimitsTests-1029117039 None] Created volume successfully. Sep 18 23:53:59 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 Sep 18 23:53:59 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:53:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-631aa01e-fd33-4f0f-98a6-ceb1e6ba7183 req-a64392e6-a1bc-4e63-bf31-2cf0955c04b6 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Terminate volume connection completed successfully. Sep 18 23:53:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-631aa01e-fd33-4f0f-98a6-ceb1e6ba7183 req-a64392e6-a1bc-4e63-bf31-2cf0955c04b6 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Deleting attachment f964ac86-6a6f-4b74-967b-9576cf2bae11. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:54:00 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5" returned: 0 in 0.510s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:00 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5 Sep 18 23:54:00 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:00 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2aa93252-ce45-46d8-bae5-e0cb386510e5" returned: 0 in 0.268s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "cinder-quobyte-2aa93252-ce45-46d8-bae5-e0cb386510e5" released by "delete_volume" :: held 0.948s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=196,cinder:DELETE=4,cinder:SELECT=183,cinder:INSERT=45 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=172,cinder:UPDATE=185,cinder:INSERT=45,cinder:DELETE=15 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Created reservations ['f1971255-8fb3-4b02-86da-239873b7708d', '024e8e14-401c-45c7-a204-82e9e2204fd7', 'dccac4d5-de93-4cfa-8699-460a43eec18c', '49535daa-4889-42a5-80a4-c6da74c435e0'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:00 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:54:00 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Acquiring lock "cinder-81dcf61d-3eb1-4167-bdde-74d32438b875-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Lock "cinder-81dcf61d-3eb1-4167-bdde-74d32438b875-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Acquiring lock "cinder-a6f0727a-3a37-407e-8ac2-510dfece015f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Acquiring lock "cinder-quobyte-81dcf61d-3eb1-4167-bdde-74d32438b875" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Lock "cinder-a6f0727a-3a37-407e-8ac2-510dfece015f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Lock "cinder-quobyte-81dcf61d-3eb1-4167-bdde-74d32438b875" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:00 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.374s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:54:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Deleted volume successfully. Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[84319cb7-cd1a-40f4-9061-e788cfad153e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-81dcf61d-3eb1-4167-bdde-74d32438b875 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Acquiring lock "cinder-quobyte-a6f0727a-3a37-407e-8ac2-510dfece015f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d33f4f36-6a88-4b46-baa5-fc5cc7c3eb52 tempest-VolumeSnapshotQuotasNegativeTestJSON-1591384058 None] Lock "cinder-2aa93252-ce45-46d8-bae5-e0cb386510e5-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Lock "cinder-quobyte-a6f0727a-3a37-407e-8ac2-510dfece015f" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[11610e70-4647-46a7-9111-d70250bbe14e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a6f0727a-3a37-407e-8ac2-510dfece015f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:01 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-81dcf61d-3eb1-4167-bdde-74d32438b875 Sep 18 23:54:01 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:01 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a6f0727a-3a37-407e-8ac2-510dfece015f Sep 18 23:54:01 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-55677979-cf3c-45ba-bc0a-55f89ce4b236 tempest-GroupsV320Test-478118187 None] Group tempest-GroupsV320Test-Group-722441099: creating Sep 18 23:54:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-55677979-cf3c-45ba-bc0a-55f89ce4b236 tempest-GroupsV320Test-478118187 None] Group tempest-GroupsV320Test-Group-722441099: created successfully Sep 18 23:54:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-55677979-cf3c-45ba-bc0a-55f89ce4b236 tempest-GroupsV320Test-478118187 None] Create group completed successfully. Sep 18 23:54:01 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-81dcf61d-3eb1-4167-bdde-74d32438b875" returned: 0 in 0.403s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-81dcf61d-3eb1-4167-bdde-74d32438b875 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:01 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-81dcf61d-3eb1-4167-bdde-74d32438b875 Sep 18 23:54:01 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:01 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a6f0727a-3a37-407e-8ac2-510dfece015f" returned: 0 in 0.418s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a6f0727a-3a37-407e-8ac2-510dfece015f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:01 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a6f0727a-3a37-407e-8ac2-510dfece015f Sep 18 23:54:01 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:01 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-81dcf61d-3eb1-4167-bdde-74d32438b875" returned: 0 in 0.270s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Lock "cinder-quobyte-81dcf61d-3eb1-4167-bdde-74d32438b875" released by "delete_volume" :: held 0.756s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Created reservations ['a2f2b4c0-5ee1-4cd8-98e5-131c683f4ac4', '9518d2db-4e35-4900-aead-bca5144f033b', '04298f2e-cf85-4d4b-81a2-6526ae6b520e', '1e416400-eecb-4aa7-929b-afd9ca2833ad'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:54:01 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a6f0727a-3a37-407e-8ac2-510dfece015f" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Lock "cinder-quobyte-a6f0727a-3a37-407e-8ac2-510dfece015f" released by "delete_volume" :: held 0.758s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:01 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:54:01 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Created reservations ['3a66077d-a498-4170-877b-ea3e420e74ba', 'ba14af74-6271-4a5f-91a8-971de56c48eb', 'e31763de-b364-4b25-aab7-ef7b7a519749', 'f2d8de7b-fa3f-46b9-9d6e-3b9c2c8138d6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:01 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:54:01 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:02 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.309s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:02 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:54:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Deleted volume successfully. Sep 18 23:54:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd680c93-bf33-4027-88e0-541bcd604001 tempest-TestServerVolumeAttachScenarioOldVersion-81236573 None] Lock "cinder-81dcf61d-3eb1-4167-bdde-74d32438b875-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:02 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.473s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:02 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:54:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Deleted volume successfully. Sep 18 23:54:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f8033432-114c-4e80-9064-c30fbe66b58c tempest-AbsoluteLimitsTests-1029117039 None] Lock "cinder-a6f0727a-3a37-407e-8ac2-510dfece015f-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:03 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-619fcb4a-ca13-4a9a-a940-f49ad60758d9 tempest-GroupsV320Test-478118187 None] Created reservations ['a0303cf2-9163-4266-977d-fed47dee780e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:54:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-619fcb4a-ca13-4a9a-a940-f49ad60758d9 tempest-GroupsV320Test-478118187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-619fcb4a-ca13-4a9a-a940-f49ad60758d9 tempest-GroupsV320Test-478118187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-619fcb4a-ca13-4a9a-a940-f49ad60758d9 tempest-GroupsV320Test-478118187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-619fcb4a-ca13-4a9a-a940-f49ad60758d9 tempest-GroupsV320Test-478118187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-619fcb4a-ca13-4a9a-a940-f49ad60758d9 tempest-GroupsV320Test-478118187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-619fcb4a-ca13-4a9a-a940-f49ad60758d9 tempest-GroupsV320Test-478118187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:03 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:54:03 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:03 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-619fcb4a-ca13-4a9a-a940-f49ad60758d9 tempest-GroupsV320Test-478118187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.299s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:03 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-619fcb4a-ca13-4a9a-a940-f49ad60758d9 tempest-GroupsV320Test-478118187 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:54:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-619fcb4a-ca13-4a9a-a940-f49ad60758d9 tempest-GroupsV320Test-478118187 None] Delete group completed successfully. Sep 18 23:54:09 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Flow 'volume_create_manager' (ee219883-834e-40e8-ade4-ad5a6f1fe1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac174590-f440-4b4d-a667-8d4bba84e05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac174590-f440-4b4d-a667-8d4bba84e05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1939271482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53578c65-e2f5-4c52-ac8f-45b85424263e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f73e629bff4928830e40441d892e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:54:10Z,use_quota=True,user_id='0c598a57c9364bfabc38052b0ac61a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0c6f00-435a-4c50-9f91-af2c1f950989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0c6f00-435a-4c50-9f91-af2c1f950989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dd6d93-b334-4170-8c70-13f7e135699b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dd6d93-b334-4170-8c70-13f7e135699b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53578c65-e2f5-4c52-ac8f-45b85424263e', 'volume_name': 'volume-53578c65-e2f5-4c52-ac8f-45b85424263e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd3b214-9e69-44ef-98f7-c02a489fc101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd3b214-9e69-44ef-98f7-c02a489fc101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b83a417-7b06-4cee-9157-f6962d5994ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Volume 53578c65-e2f5-4c52-ac8f-45b85424263e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53578c65-e2f5-4c52-ac8f-45b85424263e', 'volume_size': 1} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1939271482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53578c65-e2f5-4c52-ac8f-45b85424263e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f73e629bff4928830e40441d892e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:54:10Z,use_quota=True,user_id='0c598a57c9364bfabc38052b0ac61a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Creating volume 53578c65-e2f5-4c52-ac8f-45b85424263e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:54:10 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:10 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e 1073741824 Sep 18 23:54:10 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:10 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e 1073741824" returned: 0 in 0.619s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:10 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e Sep 18 23:54:10 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:11 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e" returned: 0 in 0.317s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:54:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b83a417-7b06-4cee-9157-f6962d5994ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53578c65-e2f5-4c52-ac8f-45b85424263e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da879fc-5884-465b-90f9-3a5a0b52542c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Volume volume-53578c65-e2f5-4c52-ac8f-45b85424263e (53578c65-e2f5-4c52-ac8f-45b85424263e): created successfully Sep 18 23:54:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da879fc-5884-465b-90f9-3a5a0b52542c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Flow 'volume_create_manager' (ee219883-834e-40e8-ade4-ad5a6f1fe1e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:54:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-79957f3d-24b8-4de1-a38e-3b62ca9cfdcd tempest-VolumesCloneTest-1079461525 None] Created volume successfully. Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Flow 'volume_create_manager' (971a5ed4-9d17-48d0-9d48-783bf68f5673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd6f748-a249-497e-8aa4-53b6a216c04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd6f748-a249-497e-8aa4-53b6a216c04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2094246788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984c4845-986b-48bf-aa42-aa7d51534bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f73e629bff4928830e40441d892e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:54:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=53578c65-e2f5-4c52-ac8f-45b85424263e,status='creating',terminated_at=None,updated_at=2026-09-18T21:54:13Z,use_quota=True,user_id='0c598a57c9364bfabc38052b0ac61a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64ab351-3010-403b-a075-02bb302ea2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64ab351-3010-403b-a075-02bb302ea2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474ef718-058c-448b-8631-542091677d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474ef718-058c-448b-8631-542091677d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '984c4845-986b-48bf-aa42-aa7d51534bea', 'volume_name': 'volume-984c4845-986b-48bf-aa42-aa7d51534bea', 'volume_size': 2, 'source_volid': '53578c65-e2f5-4c52-ac8f-45b85424263e', 'source_volstatus': 'available'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721b9d74-10b9-4553-935e-51f064876043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721b9d74-10b9-4553-935e-51f064876043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1456b1e-0aa0-44f2-adff-a7a3d9bfb7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Volume 984c4845-986b-48bf-aa42-aa7d51534bea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-984c4845-986b-48bf-aa42-aa7d51534bea', 'volume_size': 2, 'source_volid': '53578c65-e2f5-4c52-ac8f-45b85424263e', 'source_volstatus': 'available'} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:12 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Cloning volume 53578c65-e2f5-4c52-ac8f-45b85424263e to volume 984c4845-986b-48bf-aa42-aa7d51534bea Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Creating offline snapshot 063a5516-b1a7-42c5-978f-ae1e6a9beb6b of volume 53578c65-e2f5-4c52-ac8f-45b85424263e {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97f1583-3c57-4b52-a5b0-81d911d50eb4]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:13 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e Sep 18 23:54:13 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:13 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e" returned: 0 in 0.433s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:13 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b 1G Sep 18 23:54:13 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:14 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b 1G" returned: 0 in 0.600s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53578c65-e2f5-4c52-ac8f-45b85424263e -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:14 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53578c65-e2f5-4c52-ac8f-45b85424263e -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b Sep 18 23:54:14 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:14 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53578c65-e2f5-4c52-ac8f-45b85424263e -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:14 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b is being set with open permissions: ugo+rw Sep 18 23:54:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:14 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b Sep 18 23:54:14 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:14 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b" returned: 0 in 0.266s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:14 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.info Sep 18 23:54:14 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:14 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.info" returned: 0 in 0.303s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:14 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.info is being set with open permissions: ugo+rw Sep 18 23:54:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:14 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.info Sep 18 23:54:14 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:15 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.info" returned: 0 in 0.310s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Acquiring lock "cinder-quobyte-984c4845-986b-48bf-aa42-aa7d51534bea" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Lock "cinder-quobyte-984c4845-986b-48bf-aa42-aa7d51534bea" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] snapshot: 063a5516-b1a7-42c5-978f-ae1e6a9beb6b, volume: 984c4845-986b-48bf-aa42-aa7d51534bea, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[92065dd6-dfcf-4037-a499-b32501f48cf5]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:15 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b Sep 18 23:54:15 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:15 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b" returned: 0 in 0.471s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53578c65-e2f5-4c52-ac8f-45b85424263e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32811f3-af89-4720-82cc-4a63c78211bd]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:16 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e Sep 18 23:54:16 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:16 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 23:54:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 23:54:16 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Path /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 23:54:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:16 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea Sep 18 23:54:16 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:54:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:21 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:54:21 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:22 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.836s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:22 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:54:22 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:54:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:54:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:54:24 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:54:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Flow 'volume_create_manager' (98f5513d-4f81-4f87-95af-af90d33ff556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:54:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f69858-39bf-48cf-b32d-ffe8497b6547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f69858-39bf-48cf-b32d-ffe8497b6547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-6790710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4c38fb-d510-46a6-9c58-93bffcc2ea74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c8761f2dfb4852a895952dc3377b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:54:24Z,use_quota=True,user_id='2e8aec72c4e04b08895a392508a5f1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48f9218-3633-452a-adfa-0a772a60fffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48f9218-3633-452a-adfa-0a772a60fffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62b76ac-a830-4067-8edf-077d0de272a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62b76ac-a830-4067-8edf-077d0de272a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f4c38fb-d510-46a6-9c58-93bffcc2ea74', 'volume_name': 'volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a760ea-7867-473c-b30c-a9102d2131f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a760ea-7867-473c-b30c-a9102d2131f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef1b659-52dd-4302-8c22-10d1a191e8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:24 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Volume 9f4c38fb-d510-46a6-9c58-93bffcc2ea74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74', 'volume_size': 1} Sep 18 23:54:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:25 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea" returned: 0 in 9.181s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:25 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e, size 1024.00 MB, duration 9.18 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:54:25 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Converted 1024.00 MB image at 111.52 MB/s Sep 18 23:54:25 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea is being set with open permissions: ugo+rw Sep 18 23:54:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:25 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea Sep 18 23:54:25 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:25 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Lock "cinder-quobyte-984c4845-986b-48bf-aa42-aa7d51534bea" released by "_copy_volume_from_snapshot" :: held 10.484s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Acquiring lock "cinder-quobyte-063a5516-b1a7-42c5-978f-ae1e6a9beb6b" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Lock "cinder-quobyte-063a5516-b1a7-42c5-978f-ae1e6a9beb6b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Deleting offline snapshot 063a5516-b1a7-42c5-978f-ae1e6a9beb6b of volume 53578c65-e2f5-4c52-ac8f-45b85424263e {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:54:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] snapshot_file for this snap is: volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:54:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaed177-b139-44f8-9f59-a309685e1f09]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:25 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b Sep 18 23:54:25 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:26 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b" returned: 0 in 0.428s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53578c65-e2f5-4c52-ac8f-45b85424263e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:54:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f78280-8dc2-46bf-b001-17dff7245fa6]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:26 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e Sep 18 23:54:26 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:26 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e" returned: 0 in 0.623s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:26 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b Sep 18 23:54:26 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:27 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b" returned: 0 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:27 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b Sep 18 23:54:27 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:27 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e.063a5516-b1a7-42c5-978f-ae1e6a9beb6b" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Lock "cinder-quobyte-063a5516-b1a7-42c5-978f-ae1e6a9beb6b" released by "_delete_snapshot" :: held 1.833s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.808s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.052s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-6790710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4c38fb-d510-46a6-9c58-93bffcc2ea74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c8761f2dfb4852a895952dc3377b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:54:24Z,use_quota=True,user_id='2e8aec72c4e04b08895a392508a5f1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Creating volume 9f4c38fb-d510-46a6-9c58-93bffcc2ea74 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:54:27 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:27 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 1073741824 Sep 18 23:54:27 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1456b1e-0aa0-44f2-adff-a7a3d9bfb7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984c4845-986b-48bf-aa42-aa7d51534bea', 'volume_size': 2, 'source_volid': '53578c65-e2f5-4c52-ac8f-45b85424263e', 'source_volstatus': 'available'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46cb8ce4-08ee-4729-bccf-30f9226f9b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:27 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Volume volume-984c4845-986b-48bf-aa42-aa7d51534bea (984c4845-986b-48bf-aa42-aa7d51534bea): created successfully Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46cb8ce4-08ee-4729-bccf-30f9226f9b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Flow 'volume_create_manager' (971a5ed4-9d17-48d0-9d48-783bf68f5673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:54:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c9ea0b21-5630-4692-9659-ee3cb725b153 tempest-VolumesCloneTest-1079461525 None] Created volume successfully. Sep 18 23:54:28 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 1073741824" returned: 0 in 0.632s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:28 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 Sep 18 23:54:28 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:28 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" returned: 0 in 0.366s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:54:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef1b659-52dd-4302-8c22-10d1a191e8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef217ff-3b85-4211-9f83-00c3d2a7d3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Volume volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 (9f4c38fb-d510-46a6-9c58-93bffcc2ea74): created successfully Sep 18 23:54:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef217ff-3b85-4211-9f83-00c3d2a7d3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Flow 'volume_create_manager' (98f5513d-4f81-4f87-95af-af90d33ff556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:54:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3ee763af-99a9-476c-a39c-a8c2b43168cb tempest-VolumesDeleteCascade-99945145 None] Created volume successfully. Sep 18 23:54:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Acquiring lock "cinder-984c4845-986b-48bf-aa42-aa7d51534bea-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Lock "cinder-984c4845-986b-48bf-aa42-aa7d51534bea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Acquiring lock "cinder-quobyte-984c4845-986b-48bf-aa42-aa7d51534bea" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Lock "cinder-quobyte-984c4845-986b-48bf-aa42-aa7d51534bea" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[62838f17-10f9-43ba-978c-a9f181aeddad]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:29 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea Sep 18 23:54:29 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:29 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea" returned: 0 in 0.447s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:29 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea Sep 18 23:54:29 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:30 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-984c4845-986b-48bf-aa42-aa7d51534bea" returned: 0 in 0.369s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Lock "cinder-quobyte-984c4845-986b-48bf-aa42-aa7d51534bea" released by "delete_volume" :: held 0.887s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] Creating offline snapshot 0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 of volume 9f4c38fb-d510-46a6-9c58-93bffcc2ea74 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c75deb-3827-4eb8-b61e-dbae75d1684d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Created reservations ['fd6162aa-7b60-424e-ac44-b91e9dce6dea', '4346491f-f334-4ff2-acce-a6d8a325a71a', '9d4dae78-589e-4cf7-9ea2-51f6430d4ce3', '2dc90462-fa45-4907-8440-e09c6879a5fa'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:30 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 Sep 18 23:54:30 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:30 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:54:30 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Acquiring lock "cinder-53578c65-e2f5-4c52-ac8f-45b85424263e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Lock "cinder-53578c65-e2f5-4c52-ac8f-45b85424263e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Acquiring lock "cinder-quobyte-53578c65-e2f5-4c52-ac8f-45b85424263e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Lock "cinder-quobyte-53578c65-e2f5-4c52-ac8f-45b85424263e" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:30 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" returned: 0 in 0.521s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49f377a-922e-4cf6-9fce-f081817d1620]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:30 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 1G Sep 18 23:54:30 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:30 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.511s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:54:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Deleted volume successfully. Sep 18 23:54:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e3bc003-6210-4c4d-8d18-e37a9b3feabc tempest-VolumesCloneTest-1079461525 None] Lock "cinder-984c4845-986b-48bf-aa42-aa7d51534bea-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:31 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e Sep 18 23:54:31 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:31 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e" returned: 0 in 0.626s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:31 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e Sep 18 23:54:31 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:31 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 1G" returned: 0 in 0.746s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:31 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 Sep 18 23:54:31 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:31 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53578c65-e2f5-4c52-ac8f-45b85424263e" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Lock "cinder-quobyte-53578c65-e2f5-4c52-ac8f-45b85424263e" released by "delete_volume" :: held 1.082s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Created reservations ['43ddc0f3-d12f-43e7-9fb4-c1c322b253fa', 'c106fa21-3d65-400a-81ec-af37e4d2afc7', 'fa3d867f-aac6-4c21-9b34-2965eeee109a', 'c6d2096a-5b8c-4ad7-b945-ad7a1a0d427d'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:54:31 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197" returned: 0 in 0.422s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:31 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 is being set with open permissions: ugo+rw Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:31 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 Sep 18 23:54:31 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:31 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:54:31 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:32 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.313s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:32 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:54:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Deleted volume successfully. Sep 18 23:54:32 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197" returned: 0 in 0.428s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6d301533-a47b-4c0d-bef0-9d9a5c5ea3a2 tempest-VolumesCloneTest-1079461525 None] Lock "cinder-53578c65-e2f5-4c52-ac8f-45b85424263e-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:32 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.info Sep 18 23:54:32 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:32 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.info" returned: 0 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:32 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.info is being set with open permissions: ugo+rw Sep 18 23:54:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:32 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.info Sep 18 23:54:32 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:33 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.info" returned: 0 in 0.409s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.039s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cf7f137d-dd00-4da6-983d-16de87994be7 tempest-VolumesDeleteCascade-99945145 None] Create snapshot completed successfully Sep 18 23:54:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] Creating offline snapshot da001941-021d-4300-bd9a-257b26afc31b of volume 9f4c38fb-d510-46a6-9c58-93bffcc2ea74 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:54:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7478d2f5-efac-4671-8111-6a1c0884c92c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:34 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 Sep 18 23:54:34 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:35 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197" returned: 0 in 0.540s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:54:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:35 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b 1G Sep 18 23:54:35 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:35 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b 1G" returned: 0 in 0.701s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:35 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b Sep 18 23:54:35 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:36 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b" returned: 0 in 0.427s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:36 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b is being set with open permissions: ugo+rw Sep 18 23:54:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:36 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b Sep 18 23:54:36 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:36 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b" returned: 0 in 0.437s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-987818c2-f298-445a-9311-0e158f3933b1 tempest-VolumesDeleteCascade-99945145 None] Create snapshot completed successfully Sep 18 23:54:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-9f4c38fb-d510-46a6-9c58-93bffcc2ea74-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-9f4c38fb-d510-46a6-9c58-93bffcc2ea74-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Performing cascade delete. {{(pid=85963) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 18 23:54:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-0d5e4cea-bd9c-4e2f-a357-6b8c674e4197-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-0d5e4cea-bd9c-4e2f-a357-6b8c674e4197-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-quobyte-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-quobyte-0d5e4cea-bd9c-4e2f-a357-6b8c674e4197" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-0d5e4cea-bd9c-4e2f-a357-6b8c674e4197" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Deleting offline snapshot 0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 of volume 9f4c38fb-d510-46a6-9c58-93bffcc2ea74 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:54:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] snapshot_file for this snap is: volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:54:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[196b092a-08c0-43ab-90a6-b2c7ec2a2938]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:38 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 Sep 18 23:54:38 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:38 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197" returned: 0 in 0.435s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:54:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[127ee148-6c36-4406-afd7-ba275e2f8317]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:38 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 Sep 18 23:54:38 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:39 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" returned: 0 in 0.536s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f65ec1-5a0b-4677-acb3-a6a07c4191cc]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:39 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b Sep 18 23:54:39 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:39 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b" returned: 0 in 0.483s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:54:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef164ccc-a669-4796-bf5e-a4cabdc5b227]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:39 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 Sep 18 23:54:39 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:40 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197" returned: 0 in 0.627s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:54:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2762e796-3848-4606-b7a1-fee3c7100d3c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:40 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 Sep 18 23:54:40 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:40 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" returned: 0 in 0.503s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:40 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 Sep 18 23:54:40 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:41 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197" returned: 0 in 0.446s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:41 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197 Sep 18 23:54:41 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:41 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.0d5e4cea-bd9c-4e2f-a357-6b8c674e4197" returned: 0 in 0.293s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b -F qcow2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:41 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b -F qcow2 Sep 18 23:54:41 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:41 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b -F qcow2" returned: 0 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-0d5e4cea-bd9c-4e2f-a357-6b8c674e4197" released by "_delete_snapshot" :: held 3.945s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" released by "delete_snapshot" :: held 3.990s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Created reservations ['e911f267-a679-43e8-8cf7-cacc194f2d27', 'cc66e629-e511-4055-863f-1526594006bf', '0c52483b-0ea4-4984-8bb1-fc3356ca4ece', '58122135-7be7-4e95-a916-b6e73baac67e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:54:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Delete snapshot completed successfully. Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-0d5e4cea-bd9c-4e2f-a357-6b8c674e4197-delete_snapshot" released by "delete_snapshot" :: held 4.246s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-da001941-021d-4300-bd9a-257b26afc31b-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-da001941-021d-4300-bd9a-257b26afc31b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-quobyte-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-quobyte-da001941-021d-4300-bd9a-257b26afc31b" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-da001941-021d-4300-bd9a-257b26afc31b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Deleting offline snapshot da001941-021d-4300-bd9a-257b26afc31b of volume 9f4c38fb-d510-46a6-9c58-93bffcc2ea74 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] snapshot_file for this snap is: volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b53da2-3d58-4f50-b70d-418544cd39fe]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:42 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b Sep 18 23:54:42 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:42 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b" returned: 0 in 0.551s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[332fb25e-da26-4174-8f74-bfce8b6e0303]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:54:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Flow 'volume_create_manager' (af08cc3d-6a16-44f8-8c96-a70b9500429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c864f501-228d-43cd-afd5-93d17f2753e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c864f501-228d-43cd-afd5-93d17f2753e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-533707920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9a4bfe-f8d6-4d17-8b08-652c4c81e976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d795eaef9645cd94b2d01e4ff043f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:54:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:54:43Z,use_quota=True,user_id='a0d515044d7e4074bca56de9435fc53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4667a8a7-05cd-4b7f-a3f4-f59969815655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4667a8a7-05cd-4b7f-a3f4-f59969815655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a6a7eb-694e-43c1-bdca-abc6b5f81f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a6a7eb-694e-43c1-bdca-abc6b5f81f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a9a4bfe-f8d6-4d17-8b08-652c4c81e976', 'volume_name': 'volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976', 'volume_size': 2}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03024a53-bda5-4afc-90fb-0725c93f8340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:43 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 Sep 18 23:54:43 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03024a53-bda5-4afc-90fb-0725c93f8340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c2f07a-a3aa-4561-9f0a-16629526bb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Volume 0a9a4bfe-f8d6-4d17-8b08-652c4c81e976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976', 'volume_size': 2} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-533707920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9a4bfe-f8d6-4d17-8b08-652c4c81e976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d795eaef9645cd94b2d01e4ff043f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:54:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:54:43Z,use_quota=True,user_id='a0d515044d7e4074bca56de9435fc53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Creating volume 0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:54:43 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 2147483648 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:43 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 2147483648 Sep 18 23:54:43 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:43 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" returned: 0 in 0.467s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:43 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b Sep 18 23:54:43 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:43 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 2147483648" returned: 0 in 0.716s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:43 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b" returned: 0 in 0.499s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:43 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 Sep 18 23:54:43 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:43 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b Sep 18 23:54:43 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:44 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:44 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74.da001941-021d-4300-bd9a-257b26afc31b" returned: 0 in 0.299s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c2f07a-a3aa-4561-9f0a-16629526bb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976', 'volume_size': 2}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ff369b-120a-40de-8f28-3711094996b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-da001941-021d-4300-bd9a-257b26afc31b" released by "_delete_snapshot" :: held 1.989s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" released by "delete_snapshot" :: held 2.026s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:44 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Volume volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 (0a9a4bfe-f8d6-4d17-8b08-652c4c81e976): created successfully Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ff369b-120a-40de-8f28-3711094996b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Flow 'volume_create_manager' (af08cc3d-6a16-44f8-8c96-a70b9500429b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:54:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7cd1e6f9-8e6b-40a7-b64f-bc5609b8f2de tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Created volume successfully. Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Created reservations ['21657b6c-7b78-450d-8db4-d7ec5f4fad34', 'dd467e28-ea13-41ef-81ae-1b56c214ad7c', '658d0a3a-8057-4c17-b095-39413696f4a0', '276491ce-c187-4429-826f-c7cfcfdff915'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:54:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Delete snapshot completed successfully. Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-da001941-021d-4300-bd9a-257b26afc31b-delete_snapshot" released by "delete_snapshot" :: held 2.242s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Snapshots deleted, issuing volume delete {{(pid=85963) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-quobyte-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fbe74a-cac2-4e93-8d83-af864df5ea69]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:44 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 Sep 18 23:54:44 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:45 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" returned: 0 in 0.557s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:45 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74 Sep 18 23:54:45 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:45 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" returned: 0 in 0.338s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-9f4c38fb-d510-46a6-9c58-93bffcc2ea74" released by "delete_volume" :: held 1.008s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Creating offline snapshot 42379c3e-331f-4a28-9e28-a040d1d59713 of volume 0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Created reservations ['53754174-dc1b-49ba-ad03-acdd463c1fdb', '206eaa41-fa36-4507-b93a-62a6f91d472c', '8afa3679-4727-4828-b04b-36b64fe28dde', '78b276cb-4e18-413e-9d92-5efe23d16257'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7d0560-9dfa-4991-9ebc-77366dc43df7]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:45 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 Sep 18 23:54:45 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:45 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:54:45 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:46 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.396s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:46 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:54:46 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Deleted volume successfully. Sep 18 23:54:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976" returned: 0 in 0.565s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 2G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a0af565d-34e8-4b74-9110-f0d3d24d96a1 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-9f4c38fb-d510-46a6-9c58-93bffcc2ea74-delete_volume" released by "delete_volume" :: held 8.310s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:46 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 2G Sep 18 23:54:46 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:46 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 2G" returned: 0 in 0.544s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:46 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 Sep 18 23:54:46 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:47 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713" returned: 0 in 0.388s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:47 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 is being set with open permissions: ugo+rw Sep 18 23:54:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:47 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 Sep 18 23:54:47 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:47 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713" returned: 0 in 0.330s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:47 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.info Sep 18 23:54:47 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:47 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.info" returned: 0 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:47 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.info is being set with open permissions: ugo+rw Sep 18 23:54:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:47 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.info Sep 18 23:54:47 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:48 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.info" returned: 0 in 0.412s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.741s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Flow 'volume_create_manager' (6a2b7888-dc93-438b-afda-23251d702357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f817d21-2822-461b-b58e-5f37b150823c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f817d21-2822-461b-b58e-5f37b150823c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-917788092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd8dafb-9ddc-45b7-92e0-4f4a00fd866c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c8761f2dfb4852a895952dc3377b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:54:48Z,use_quota=True,user_id='2e8aec72c4e04b08895a392508a5f1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135ce30d-b67e-4412-baeb-ac7d18a8b58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135ce30d-b67e-4412-baeb-ac7d18a8b58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f38f78-acd6-443f-b683-fc082c5e2a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f38f78-acd6-443f-b683-fc082c5e2a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd8dafb-9ddc-45b7-92e0-4f4a00fd866c', 'volume_name': 'volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7122a46e-98cd-47cb-885a-56a7e6db0980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7122a46e-98cd-47cb-885a-56a7e6db0980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d5ddd3-2f25-40cc-b680-33f8cc51d3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:48 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Volume edd8dafb-9ddc-45b7-92e0-4f4a00fd866c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c', 'volume_size': 1} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-917788092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd8dafb-9ddc-45b7-92e0-4f4a00fd866c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c8761f2dfb4852a895952dc3377b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:54:48Z,use_quota=True,user_id='2e8aec72c4e04b08895a392508a5f1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Creating volume edd8dafb-9ddc-45b7-92e0-4f4a00fd866c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:54:48 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7816419a-ae4f-4d1d-8cc5-d99958007861 tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Create snapshot completed successfully Sep 18 23:54:48 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c 1073741824 Sep 18 23:54:48 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Acquiring lock "cinder-42379c3e-331f-4a28-9e28-a040d1d59713-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "cinder-42379c3e-331f-4a28-9e28-a040d1d59713-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Acquiring lock "cinder-quobyte-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "cinder-quobyte-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Acquiring lock "cinder-quobyte-42379c3e-331f-4a28-9e28-a040d1d59713" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "cinder-quobyte-42379c3e-331f-4a28-9e28-a040d1d59713" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Deleting offline snapshot 42379c3e-331f-4a28-9e28-a040d1d59713 of volume 0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] snapshot_file for this snap is: volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f0552d-ff6d-4240-8129-b707baba88ab]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:49 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c 1073741824" returned: 0 in 0.695s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:49 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 Sep 18 23:54:49 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:49 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c Sep 18 23:54:49 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:49 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713" returned: 0 in 0.477s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc68b453-8984-4a37-9969-e9a7af1b2949]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:49 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c" returned: 0 in 0.357s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d5ddd3-2f25-40cc-b680-33f8cc51d3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc5f5b5-4bf7-460b-af2d-f7829d4b2974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:49 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Volume volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c (edd8dafb-9ddc-45b7-92e0-4f4a00fd866c): created successfully Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc5f5b5-4bf7-460b-af2d-f7829d4b2974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Flow 'volume_create_manager' (6a2b7888-dc93-438b-afda-23251d702357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:54:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b31b2ecf-a968-47dc-b160-14cc08696a42 tempest-VolumesDeleteCascade-99945145 None] Created volume successfully. Sep 18 23:54:49 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 Sep 18 23:54:49 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:49 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976" returned: 0 in 0.521s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:50 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 Sep 18 23:54:50 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:50 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713" returned: 0 in 0.426s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:50 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713 Sep 18 23:54:50 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] Creating offline snapshot 987ca282-6524-4540-9e92-6c4d2c77b705 of volume edd8dafb-9ddc-45b7-92e0-4f4a00fd866c {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:54:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8f316b-fe7e-4a89-bb69-732f9ed78f97]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:50 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c Sep 18 23:54:50 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:50 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976.42379c3e-331f-4a28-9e28-a040d1d59713" returned: 0 in 0.355s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "cinder-quobyte-42379c3e-331f-4a28-9e28-a040d1d59713" released by "_delete_snapshot" :: held 1.950s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "cinder-quobyte-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976" released by "delete_snapshot" :: held 1.990s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:50 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Created reservations ['62924293-afba-4e26-bcc5-e96d4d6c0e65', 'e81382ec-bc4b-408f-815c-568addb6e1b0', '3f153036-c17a-420f-a02c-3af623c6e2fb', '18b70b7e-5521-4e1f-a492-b601c42a33b3'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:54:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Delete snapshot completed successfully. Sep 18 23:54:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cdd7054-0203-48c2-be1a-0b5dc399123f tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "cinder-42379c3e-331f-4a28-9e28-a040d1d59713-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:51 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c" returned: 0 in 0.549s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:51 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 1G Sep 18 23:54:51 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:51 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 1G" returned: 0 in 0.599s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:51 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 Sep 18 23:54:51 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:52 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705" returned: 0 in 0.370s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:52 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 is being set with open permissions: ugo+rw Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:52 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 Sep 18 23:54:52 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Acquiring lock "cinder-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "cinder-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Acquiring lock "cinder-quobyte-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "cinder-quobyte-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7d2b58-3acf-40ef-ba67-2cb49fae04f8]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:52 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705" returned: 0 in 0.404s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:52 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 Sep 18 23:54:52 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:52 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.info Sep 18 23:54:52 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:52 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976" returned: 0 in 0.489s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:52 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976 Sep 18 23:54:52 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:52 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.info" returned: 0 in 0.359s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:52 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.info is being set with open permissions: ugo+rw Sep 18 23:54:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:52 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.info Sep 18 23:54:52 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:53 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976" returned: 0 in 0.294s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "cinder-quobyte-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976" released by "delete_volume" :: held 0.867s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:53 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.info" returned: 0 in 0.297s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.745s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Created reservations ['97a244c0-ff4e-468f-aad2-d1b23d013e12', '52202663-984c-41fd-9d2f-769c498c224c', 'a1100442-a05d-4d2c-938f-e5056c59ccce', 'd184f844-a3ed-47b8-bb36-810e589a06b9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:54:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-14d345d3-cc66-468c-9a8f-927481342444 tempest-VolumesDeleteCascade-99945145 None] Create snapshot completed successfully Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:53 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:54:53 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:53 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.427s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:54:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Deleted volume successfully. Sep 18 23:54:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0f1b2ad6-83e9-4248-be3a-3cafa31210da tempest-VolumesSnapshotNegativeTestJSON-1829064073 None] Lock "cinder-0a9a4bfe-f8d6-4d17-8b08-652c4c81e976-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Flow 'volume_create_manager' (6a78f217-f469-4ad7-a39e-fc83f0ef24e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad1bdc2-382e-4379-8cfc-94a06566d8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad1bdc2-382e-4379-8cfc-94a06566d8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1191093146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094cbb4c-549f-475d-87af-624c99d71c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c8761f2dfb4852a895952dc3377b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=987ca282-6524-4540-9e92-6c4d2c77b705,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:54:54Z,use_quota=True,user_id='2e8aec72c4e04b08895a392508a5f1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbaebffd-0aa5-4575-8ecf-651f589379ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbaebffd-0aa5-4575-8ecf-651f589379ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ba61c6-5c1b-4bfa-a92c-dc6181efeeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ba61c6-5c1b-4bfa-a92c-dc6181efeeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '094cbb4c-549f-475d-87af-624c99d71c10', 'volume_name': 'volume-094cbb4c-549f-475d-87af-624c99d71c10', 'volume_size': 1, 'snapshot_id': '987ca282-6524-4540-9e92-6c4d2c77b705'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34836e8-d981-4a90-8b0b-bfad4e384544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34836e8-d981-4a90-8b0b-bfad4e384544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32af9b52-7ff5-4781-b972-cc8b5f14384f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Volume 094cbb4c-549f-475d-87af-624c99d71c10: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-094cbb4c-549f-475d-87af-624c99d71c10', 'volume_size': 1, 'snapshot_id': '987ca282-6524-4540-9e92-6c4d2c77b705'} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-quobyte-987ca282-6524-4540-9e92-6c4d2c77b705-094cbb4c-549f-475d-87af-624c99d71c10" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-987ca282-6524-4540-9e92-6c4d2c77b705-094cbb4c-549f-475d-87af-624c99d71c10" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Creating volume 094cbb4c-549f-475d-87af-624c99d71c10 from snapshot 987ca282-6524-4540-9e92-6c4d2c77b705 {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-quobyte-094cbb4c-549f-475d-87af-624c99d71c10" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-094cbb4c-549f-475d-87af-624c99d71c10" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] snapshot: 987ca282-6524-4540-9e92-6c4d2c77b705, volume: 094cbb4c-549f-475d-87af-624c99d71c10, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fe6091-7790-4b8f-9732-297f2bdc8786]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:54 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 Sep 18 23:54:54 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:55 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:54:55 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bc4908-d473-45b6-83b0-e9eeaba13304]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:54:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:55 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c Sep 18 23:54:55 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:55 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Sep 18 23:54:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c" returned: 0 in 0.413s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:54:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 23:54:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 23:54:55 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Path /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 23:54:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:54:55 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10 Sep 18 23:54:55 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:54:59 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:54:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Flow 'volume_create_manager' (cff3f403-4af0-4f26-8604-88323a09bbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:54:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fc7fd9-48a2-4541-bac3-6155c3690394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fc7fd9-48a2-4541-bac3-6155c3690394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-538915593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5425c925-4202-4ff0-a7e0-4f2539cdaa39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e460a3a6990c4774b30a4067d9434b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:54:59Z,use_quota=True,user_id='3e545fb1f4e04be7ba891bcc53dbdd44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d23045f-82c0-43bb-b03b-51a0e3359be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d23045f-82c0-43bb-b03b-51a0e3359be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5c84ed-09e7-453f-bfbe-ae35b2f07f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5c84ed-09e7-453f-bfbe-ae35b2f07f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5425c925-4202-4ff0-a7e0-4f2539cdaa39', 'volume_name': 'volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a46ff2a-250d-4494-a29f-adf260b7c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a46ff2a-250d-4494-a29f-adf260b7c54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:54:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73036daf-95a8-4943-9350-0250fc54e2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:54:59 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Volume 5425c925-4202-4ff0-a7e0-4f2539cdaa39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39', 'volume_size': 1} Sep 18 23:54:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:05 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10" returned: 0 in 9.526s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c, size 1024.00 MB, duration 9.53 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:55:05 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Converted 1024.00 MB image at 107.48 MB/s Sep 18 23:55:05 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10 is being set with open permissions: ugo+rw Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:05 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10 Sep 18 23:55:05 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:05 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10" returned: 0 in 0.264s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-094cbb4c-549f-475d-87af-624c99d71c10" released by "_copy_volume_from_snapshot" :: held 10.738s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=83,cinder:INSERT=30,cinder:UPDATE=98,cinder:DELETE=12 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=100,cinder:SELECT=86,cinder:DELETE=4,cinder:INSERT=21 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-987ca282-6524-4540-9e92-6c4d2c77b705-094cbb4c-549f-475d-87af-624c99d71c10" released by "_create_volume_from_snapshot" :: held 10.826s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.853s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.718s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-538915593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5425c925-4202-4ff0-a7e0-4f2539cdaa39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e460a3a6990c4774b30a4067d9434b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:54:59Z,use_quota=True,user_id='3e545fb1f4e04be7ba891bcc53dbdd44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Creating volume 5425c925-4202-4ff0-a7e0-4f2539cdaa39 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:55:05 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:05 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 1073741824 Sep 18 23:55:05 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32af9b52-7ff5-4781-b972-cc8b5f14384f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094cbb4c-549f-475d-87af-624c99d71c10', 'volume_size': 1, 'snapshot_id': '987ca282-6524-4540-9e92-6c4d2c77b705'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b198f9e0-a45c-436f-81f9-e22f4ad87cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Volume volume-094cbb4c-549f-475d-87af-624c99d71c10 (094cbb4c-549f-475d-87af-624c99d71c10): created successfully Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b198f9e0-a45c-436f-81f9-e22f4ad87cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Flow 'volume_create_manager' (6a78f217-f469-4ad7-a39e-fc83f0ef24e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2e1ffc62-238c-450a-be86-9fa83df01695 tempest-VolumesDeleteCascade-99945145 None] Created volume successfully. Sep 18 23:55:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Performing cascade delete. {{(pid=85963) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-987ca282-6524-4540-9e92-6c4d2c77b705-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-987ca282-6524-4540-9e92-6c4d2c77b705-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:06 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 1073741824" returned: 0 in 0.702s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-quobyte-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-quobyte-987ca282-6524-4540-9e92-6c4d2c77b705" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-987ca282-6524-4540-9e92-6c4d2c77b705" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Deleting offline snapshot 987ca282-6524-4540-9e92-6c4d2c77b705 of volume edd8dafb-9ddc-45b7-92e0-4f4a00fd866c {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:55:06 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 Sep 18 23:55:06 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] snapshot_file for this snap is: volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[24113bfb-3041-453d-aa10-5f30cc17257b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:06 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 Sep 18 23:55:06 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:06 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73036daf-95a8-4943-9350-0250fc54e2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c408b5-be67-4bb8-8429-075457d14568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:06 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Volume volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 (5425c925-4202-4ff0-a7e0-4f2539cdaa39): created successfully Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c408b5-be67-4bb8-8429-075457d14568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Flow 'volume_create_manager' (cff3f403-4af0-4f26-8604-88323a09bbd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:06 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-07382f6f-a27e-41ff-b033-fda931d93667 tempest-TestStampPattern-1014361966 None] Created volume successfully. Sep 18 23:55:06 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705" returned: 0 in 0.445s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f960986f-df0f-4163-b1c8-c8e3b6dc9138]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:06 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c Sep 18 23:55:06 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:07 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c" returned: 0 in 0.726s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:07 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 Sep 18 23:55:07 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:08 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705" returned: 0 in 0.524s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:08 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705 Sep 18 23:55:08 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:08 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c.987ca282-6524-4540-9e92-6c4d2c77b705" returned: 0 in 0.313s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-987ca282-6524-4540-9e92-6c4d2c77b705" released by "_delete_snapshot" :: held 2.176s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c" released by "delete_snapshot" :: held 2.233s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:08 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Created reservations ['4fcdaf01-1ad9-44a9-86a0-20cc8753eaf9', '3f2baca9-e3e9-4c12-ae9b-fd412772fb8c', 'febe1b1c-0af4-4098-b93a-9bc55a19f26c', '9245e578-89c0-42c0-bf14-465da3d986c0'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:55:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Delete snapshot completed successfully. Sep 18 23:55:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-987ca282-6524-4540-9e92-6c4d2c77b705-delete_snapshot" released by "delete_snapshot" :: held 2.462s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Snapshots deleted, issuing volume delete {{(pid=85963) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 18 23:55:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-quobyte-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f842e3-709a-4da0-979e-da3d18be3acb]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:08 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c Sep 18 23:55:08 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:09 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c" returned: 0 in 0.624s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:09 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c Sep 18 23:55:09 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:09 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c" returned: 0 in 0.365s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c" released by "delete_volume" :: held 1.109s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:09 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Created reservations ['7317a982-d08d-406b-9f90-1b7a787470de', 'df12860b-a521-4d6f-980c-75851b2805dd', 'a1e81d09-0aa6-47fd-8c50-52bc31b95f44', '30ed500f-00ce-44be-ba60-487e876adb93'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:55:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:09 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:55:09 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:10 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.332s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:10 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:55:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Deleted volume successfully. Sep 18 23:55:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1742e39-92f3-4d2a-92e8-93780bb239f2 tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-edd8dafb-9ddc-45b7-92e0-4f4a00fd866c-delete_volume" released by "delete_volume" :: held 4.246s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-094cbb4c-549f-475d-87af-624c99d71c10-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-094cbb4c-549f-475d-87af-624c99d71c10-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "cinder-quobyte-094cbb4c-549f-475d-87af-624c99d71c10" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-094cbb4c-549f-475d-87af-624c99d71c10" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb85ac6f-7f1b-40a4-91ac-fd57094471b7]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:11 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10 Sep 18 23:55:11 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:11 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10" returned: 0 in 0.555s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:11 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10 Sep 18 23:55:11 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:11 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-094cbb4c-549f-475d-87af-624c99d71c10" returned: 0 in 0.349s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-quobyte-094cbb4c-549f-475d-87af-624c99d71c10" released by "delete_volume" :: held 0.980s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:11 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Created reservations ['f16b2881-27ed-46e9-9b35-2d50d52ca7bd', 'fdab738e-0747-46f2-b561-b282777817d5', '00ac270d-4ee6-4351-a0da-40631ec911d6', 'ced2b08c-e01f-4474-935c-9aa8cea8ca01'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:55:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:12 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:55:12 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:12 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.294s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:12 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:55:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Deleted volume successfully. Sep 18 23:55:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0b3e5e9f-e693-4f73-8948-38180d0b469e tempest-VolumesDeleteCascade-99945145 None] Lock "cinder-094cbb4c-549f-475d-87af-624c99d71c10-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:18 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:55:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Flow 'volume_create_manager' (bc33c125-62a7-48f9-8597-55a4a62a2b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88ec43c-7d2f-4b07-af57-da87f298e9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88ec43c-7d2f-4b07-af57-da87f298e9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2064434472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac616c08-01c5-4399-bbec-59bf1acff90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71699fb0f5384be9918338caf9bdad62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:19Z,use_quota=True,user_id='60143c4fcbcc46ce87039ccf5088e1c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faf6502-1617-449c-ba1d-98ff3e4de7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faf6502-1617-449c-ba1d-98ff3e4de7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd7634a-895a-4d76-b769-ef5282e9aab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd7634a-895a-4d76-b769-ef5282e9aab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac616c08-01c5-4399-bbec-59bf1acff90b', 'volume_name': 'volume-ac616c08-01c5-4399-bbec-59bf1acff90b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9d9ab7-82a0-40c3-a508-00f184acd53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9d9ab7-82a0-40c3-a508-00f184acd53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76af2f44-0763-46ab-86c4-58ac9c0059e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Volume ac616c08-01c5-4399-bbec-59bf1acff90b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac616c08-01c5-4399-bbec-59bf1acff90b', 'volume_size': 1} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2064434472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac616c08-01c5-4399-bbec-59bf1acff90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71699fb0f5384be9918338caf9bdad62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:19Z,use_quota=True,user_id='60143c4fcbcc46ce87039ccf5088e1c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Creating volume ac616c08-01c5-4399-bbec-59bf1acff90b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:55:19 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ac616c08-01c5-4399-bbec-59bf1acff90b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:19 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ac616c08-01c5-4399-bbec-59bf1acff90b 1073741824 Sep 18 23:55:19 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:19 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ac616c08-01c5-4399-bbec-59bf1acff90b 1073741824" returned: 0 in 0.524s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ac616c08-01c5-4399-bbec-59bf1acff90b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:19 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ac616c08-01c5-4399-bbec-59bf1acff90b Sep 18 23:55:19 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:20 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ac616c08-01c5-4399-bbec-59bf1acff90b" returned: 0 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:55:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76af2f44-0763-46ab-86c4-58ac9c0059e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac616c08-01c5-4399-bbec-59bf1acff90b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44939681-736b-4535-a08c-5208f4f6b700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Volume volume-ac616c08-01c5-4399-bbec-59bf1acff90b (ac616c08-01c5-4399-bbec-59bf1acff90b): created successfully Sep 18 23:55:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44939681-736b-4535-a08c-5208f4f6b700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Flow 'volume_create_manager' (bc33c125-62a7-48f9-8597-55a4a62a2b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f8ecf090-2845-4d44-9f54-40e20aa52877 tempest-VolumesMetadataTest-381676712 None] Created volume successfully. Sep 18 23:55:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:55:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:21 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:55:21 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:21 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.434s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:55:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:55:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:55:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:55:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Acquiring lock "cinder-ac616c08-01c5-4399-bbec-59bf1acff90b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Lock "cinder-ac616c08-01c5-4399-bbec-59bf1acff90b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Acquiring lock "cinder-quobyte-ac616c08-01c5-4399-bbec-59bf1acff90b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Lock "cinder-quobyte-ac616c08-01c5-4399-bbec-59bf1acff90b" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87742cb-f035-4f5a-95b4-121e0b73ded2]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ac616c08-01c5-4399-bbec-59bf1acff90b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:22 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ac616c08-01c5-4399-bbec-59bf1acff90b Sep 18 23:55:22 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:22 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ac616c08-01c5-4399-bbec-59bf1acff90b" returned: 0 in 0.496s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ac616c08-01c5-4399-bbec-59bf1acff90b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:22 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ac616c08-01c5-4399-bbec-59bf1acff90b Sep 18 23:55:22 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:23 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ac616c08-01c5-4399-bbec-59bf1acff90b" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Lock "cinder-quobyte-ac616c08-01c5-4399-bbec-59bf1acff90b" released by "delete_volume" :: held 0.839s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:23 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Created reservations ['4b702761-9e2d-40df-8767-03f990465ee0', 'c23c8e2d-0d9e-4906-9eb5-688d85a4769f', '47ed6967-f117-4208-bcf7-3bf1d749f984', '0e1deffb-2c43-435e-8421-10628f2f796a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:55:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:23 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:55:23 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:23 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.357s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:23 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:55:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Deleted volume successfully. Sep 18 23:55:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7e7a1ef8-e62b-4020-928b-46df40839c35 tempest-VolumesMetadataTest-381676712 None] Lock "cinder-ac616c08-01c5-4399-bbec-59bf1acff90b-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=23,cinder:INSERT=12,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Flow 'volume_create_manager' (24fd0422-d66b-4ffb-8383-bb4a01cecb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37046d32-61d9-4bc3-b4c4-88124b5b44f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37046d32-61d9-4bc3-b4c4-88124b5b44f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1714942322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945b1b28-91bb-4fbb-8ef2-1687b2325e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a3448306d34ac8b3e0b3429b7e9572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:33Z,use_quota=True,user_id='179aeeed80414ee28029600767390b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b391ee9-d75e-45b3-aa5e-e08ba26c8210),volume_type_id=0b391ee9-d75e-45b3-aa5e-e08ba26c8210)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8ad1a2-6984-4afa-af17-61c99f92a9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8ad1a2-6984-4afa-af17-61c99f92a9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2459812a-53f1-4e8e-bc84-0987f8b231e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2459812a-53f1-4e8e-bc84-0987f8b231e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945b1b28-91bb-4fbb-8ef2-1687b2325e5d', 'volume_name': 'volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13457e5-b678-4e36-acbf-99e8849da8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13457e5-b678-4e36-acbf-99e8849da8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1004a6b2-bf50-49b3-8daf-c00477bf7c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:33 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Volume 945b1b28-91bb-4fbb-8ef2-1687b2325e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d', 'volume_size': 1} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1714942322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945b1b28-91bb-4fbb-8ef2-1687b2325e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a3448306d34ac8b3e0b3429b7e9572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:33Z,use_quota=True,user_id='179aeeed80414ee28029600767390b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b391ee9-d75e-45b3-aa5e-e08ba26c8210),volume_type_id=0b391ee9-d75e-45b3-aa5e-e08ba26c8210)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Creating volume 945b1b28-91bb-4fbb-8ef2-1687b2325e5d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:55:33 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:55:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:33 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d 1073741824 Sep 18 23:55:33 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Flow 'volume_create_manager' (b6eb46e0-177d-43db-a49f-ee617fa435a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b3ce9f-776e-4908-b408-3a0a6c7d8b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b3ce9f-776e-4908-b408-3a0a6c7d8b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1748995990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8adbd50-2b7c-4a17-ac2a-423e9d90317d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a3448306d34ac8b3e0b3429b7e9572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:34Z,use_quota=True,user_id='179aeeed80414ee28029600767390b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3bf3cb0-0e83-4a9c-a154-dbd1e8b919d2),volume_type_id=e3bf3cb0-0e83-4a9c-a154-dbd1e8b919d2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d6da7e-f834-46cc-a9d8-2514d70e7420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d6da7e-f834-46cc-a9d8-2514d70e7420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43ad672-60e5-4477-bd2f-fe38ccc7dfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43ad672-60e5-4477-bd2f-fe38ccc7dfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8adbd50-2b7c-4a17-ac2a-423e9d90317d', 'volume_name': 'volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505b417d-c8f8-4001-bd60-07197ffee630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505b417d-c8f8-4001-bd60-07197ffee630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1631858d-752a-47fa-ac01-c3d4b1d4decb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:34 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Volume b8adbd50-2b7c-4a17-ac2a-423e9d90317d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d', 'volume_size': 1} Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:34 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d 1073741824" returned: 0 in 0.880s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:34 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d Sep 18 23:55:34 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:35 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d" returned: 0 in 0.724s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.267s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1748995990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8adbd50-2b7c-4a17-ac2a-423e9d90317d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a3448306d34ac8b3e0b3429b7e9572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:34Z,use_quota=True,user_id='179aeeed80414ee28029600767390b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3bf3cb0-0e83-4a9c-a154-dbd1e8b919d2),volume_type_id=e3bf3cb0-0e83-4a9c-a154-dbd1e8b919d2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Creating volume b8adbd50-2b7c-4a17-ac2a-423e9d90317d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:55:35 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1004a6b2-bf50-49b3-8daf-c00477bf7c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:35 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d 1073741824 Sep 18 23:55:35 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb81e47-d5e4-4789-825d-a471586f8b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Volume volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d (945b1b28-91bb-4fbb-8ef2-1687b2325e5d): created successfully Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb81e47-d5e4-4789-825d-a471586f8b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Flow 'volume_create_manager' (24fd0422-d66b-4ffb-8383-bb4a01cecb12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-00b149a8-c1ba-446a-a0c9-4024b4525925 tempest-TestInstancesWithCinderVolumes-223214885 None] Created volume successfully. Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Flow 'volume_create_manager' (00fef8cd-32a2-4cc4-8d12-04b99057338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6f50ee-19bb-4b97-8ff3-b45eb284dd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6f50ee-19bb-4b97-8ff3-b45eb284dd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1202098838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdee686-257e-4473-aeea-695d6b6cda2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a3448306d34ac8b3e0b3429b7e9572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:36Z,use_quota=True,user_id='179aeeed80414ee28029600767390b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42fc5c82-6aad-45a9-85e6-4dc612e1d830),volume_type_id=42fc5c82-6aad-45a9-85e6-4dc612e1d830)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c74ff0e-22c8-40c4-b584-0427d4f4e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c74ff0e-22c8-40c4-b584-0427d4f4e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539d9d05-0c41-44a8-844d-ba92657f8e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 23:55:36 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d 1073741824" returned: 0 in 0.892s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Flow 'volume_create_manager' (7e43ad63-ad42-41d7-9f35-a5e539813cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30828ed3-61dd-460e-8e53-0b58bf515c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30828ed3-61dd-460e-8e53-0b58bf515c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2099424778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2214dc98-303d-4ba7-b036-aac2c681e4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72341e2acfcf462d9494b25f9d508389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:36Z,use_quota=True,user_id='308eeaefce134c9a872276c42ebf8ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00ff3b5-aa73-40a7-af34-db2d7e494b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00ff3b5-aa73-40a7-af34-db2d7e494b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867efb06-7f64-464b-b527-0583708d4392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867efb06-7f64-464b-b527-0583708d4392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2214dc98-303d-4ba7-b036-aac2c681e4a3', 'volume_name': 'volume-2214dc98-303d-4ba7-b036-aac2c681e4a3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c5045d-fb04-4d0a-8b1a-000769ae9b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c5045d-fb04-4d0a-8b1a-000769ae9b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390d6b33-6772-456d-8e35-15197d97f044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Volume 2214dc98-303d-4ba7-b036-aac2c681e4a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2214dc98-303d-4ba7-b036-aac2c681e4a3', 'volume_size': 1} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:36 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d Sep 18 23:55:36 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:37 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539d9d05-0c41-44a8-844d-ba92657f8e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6bdee686-257e-4473-aeea-695d6b6cda2e', 'volume_name': 'volume-6bdee686-257e-4473-aeea-695d6b6cda2e', 'volume_size': 1, 'image_id': '90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--276090128', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a3448306d34ac8b3e0b3429b7e9572', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'created_at': datetime.datetime(2026, 9, 18, 21, 55, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 55, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90e1840c-3afd-4f27-9c89-d7a457baa3ff/file', 'properties': {}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (209db890-d9a4-4f0c-94ab-a543bc27bfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (209db890-d9a4-4f0c-94ab-a543bc27bfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63be5b85-02fd-43a2-be55-7e503ade55e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:37 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Volume 6bdee686-257e-4473-aeea-695d6b6cda2e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6bdee686-257e-4473-aeea-695d6b6cda2e', 'volume_size': 1, 'image_id': '90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--276090128', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a3448306d34ac8b3e0b3429b7e9572', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'created_at': datetime.datetime(2026, 9, 18, 21, 55, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 55, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90e1840c-3afd-4f27-9c89-d7a457baa3ff/file', 'properties': {}}, 'image_service': } Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Trying to clone 6bdee686-257e-4473-aeea-695d6b6cda2e from image 90e1840c-3afd-4f27-9c89-d7a457baa3ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d" returned: 0 in 0.530s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.614s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2099424778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2214dc98-303d-4ba7-b036-aac2c681e4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72341e2acfcf462d9494b25f9d508389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:36Z,use_quota=True,user_id='308eeaefce134c9a872276c42ebf8ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Creating volume 2214dc98-303d-4ba7-b036-aac2c681e4a3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:55:37 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2214dc98-303d-4ba7-b036-aac2c681e4a3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1631858d-752a-47fa-ac01-c3d4b1d4decb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78aa19d-198d-4d6f-8ee1-0e9d35743b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:37 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Volume volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d (b8adbd50-2b7c-4a17-ac2a-423e9d90317d): created successfully Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78aa19d-198d-4d6f-8ee1-0e9d35743b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:37 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2214dc98-303d-4ba7-b036-aac2c681e4a3 1073741824 Sep 18 23:55:37 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Flow 'volume_create_manager' (b6eb46e0-177d-43db-a49f-ee617fa435a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f1207aa2-eefb-41dc-8301-60ebe11b3083 tempest-TestInstancesWithCinderVolumes-223214885 None] Created volume successfully. Sep 18 23:55:38 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2214dc98-303d-4ba7-b036-aac2c681e4a3 1073741824" returned: 0 in 1.216s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2214dc98-303d-4ba7-b036-aac2c681e4a3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:38 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2214dc98-303d-4ba7-b036-aac2c681e4a3 Sep 18 23:55:38 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:39 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2214dc98-303d-4ba7-b036-aac2c681e4a3" returned: 0 in 0.735s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:55:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390d6b33-6772-456d-8e35-15197d97f044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2214dc98-303d-4ba7-b036-aac2c681e4a3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5226056-d248-4791-bd9d-a8d59157c2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:39 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Volume volume-2214dc98-303d-4ba7-b036-aac2c681e4a3 (2214dc98-303d-4ba7-b036-aac2c681e4a3): created successfully Sep 18 23:55:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5226056-d248-4791-bd9d-a8d59157c2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Flow 'volume_create_manager' (7e43ad63-ad42-41d7-9f35-a5e539813cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-97ca2b68-c89d-4b5b-b8ef-c40f34b70578 tempest-VolumesTransfersV357Test-51086446 None] Created volume successfully. Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Flow 'volume_create_manager' (8d3824c1-516b-4d1c-96d1-f4ecba78b7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea076587-d7da-4af8-9fe8-33b55290017e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea076587-d7da-4af8-9fe8-33b55290017e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-125227946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d78a3ba-a690-45d2-ab7b-2659edc04b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284acdbf9c4a41b3ac50d17e54fdafb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:42Z,use_quota=True,user_id='bdc220816d6045a0bf4e949750bee31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd9b51c-d46c-4d30-b82f-88e7b5eff6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd9b51c-d46c-4d30-b82f-88e7b5eff6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f54ad1e-85c9-44c8-a22f-2bd22b36d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f54ad1e-85c9-44c8-a22f-2bd22b36d019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d78a3ba-a690-45d2-ab7b-2659edc04b46', 'volume_name': 'volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd621566-211a-41d6-a309-51ebc4eb75c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd621566-211a-41d6-a309-51ebc4eb75c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff9187f-4b18-4768-8a1b-71df3575e66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:42 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Volume 8d78a3ba-a690-45d2-ab7b-2659edc04b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46', 'volume_size': 1} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-125227946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d78a3ba-a690-45d2-ab7b-2659edc04b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284acdbf9c4a41b3ac50d17e54fdafb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:42Z,use_quota=True,user_id='bdc220816d6045a0bf4e949750bee31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Creating volume 8d78a3ba-a690-45d2-ab7b-2659edc04b46 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:55:42 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:55:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:42 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46 1073741824 Sep 18 23:55:42 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-83b2c733-8815-49fc-88f7-c0d51715d065 tempest-VolumesTransfersV357Test-1124885119 None] Transfer volume completed successfully. Sep 18 23:55:43 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46 1073741824" returned: 0 in 1.258s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:44 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46 Sep 18 23:55:44 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Acquiring lock "cinder-2214dc98-303d-4ba7-b036-aac2c681e4a3-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Lock "cinder-2214dc98-303d-4ba7-b036-aac2c681e4a3-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Acquiring lock "cinder-quobyte-2214dc98-303d-4ba7-b036-aac2c681e4a3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Lock "cinder-quobyte-2214dc98-303d-4ba7-b036-aac2c681e4a3" acquired by "delete_volume" :: waited 0.052s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[43def91c-dd92-4cc5-8651-3747edce4931]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2214dc98-303d-4ba7-b036-aac2c681e4a3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:44 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46" returned: 0 in 0.491s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff9187f-4b18-4768-8a1b-71df3575e66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d2a17b-889a-43f3-84f5-6984fd157d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:44 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2214dc98-303d-4ba7-b036-aac2c681e4a3 Sep 18 23:55:44 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:44 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Volume volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46 (8d78a3ba-a690-45d2-ab7b-2659edc04b46): created successfully Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d2a17b-889a-43f3-84f5-6984fd157d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Flow 'volume_create_manager' (8d3824c1-516b-4d1c-96d1-f4ecba78b7b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-91631201-678c-4b41-ad60-35c3ea4ae573 tempest-VolumesActionsTest-1771057458 None] Created volume successfully. Sep 18 23:55:45 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2214dc98-303d-4ba7-b036-aac2c681e4a3" returned: 0 in 0.529s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2214dc98-303d-4ba7-b036-aac2c681e4a3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:45 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2214dc98-303d-4ba7-b036-aac2c681e4a3 Sep 18 23:55:45 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:45 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2214dc98-303d-4ba7-b036-aac2c681e4a3" returned: 0 in 0.498s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Lock "cinder-quobyte-2214dc98-303d-4ba7-b036-aac2c681e4a3" released by "delete_volume" :: held 1.107s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:45 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Created reservations ['edeb77b9-1bd0-496c-910e-124579e274f8', 'b1ac1476-5423-484e-8675-d970c77fb877', '2cd48d4b-bae5-455a-a8a0-a2c10b177838', '447401d0-8109-4112-a001-36dc3301c0ca'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:55:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-747d346d-228a-4265-a8ed-e8e18d8c7a22 tempest-VolumesActionsTest-1771057458 None] Acquiring lock "cinder-8d78a3ba-a690-45d2-ab7b-2659edc04b46" by "attach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-747d346d-228a-4265-a8ed-e8e18d8c7a22 tempest-VolumesActionsTest-1771057458 None] Lock "cinder-8d78a3ba-a690-45d2-ab7b-2659edc04b46" acquired by "attach_volume" :: waited 0.082s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:46 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:55:46 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-747d346d-228a-4265-a8ed-e8e18d8c7a22 tempest-VolumesActionsTest-1771057458 None] Attaching volume 8d78a3ba-a690-45d2-ab7b-2659edc04b46 to instance 8d7abbe8-f3fc-45f7-83d3-4d7eec7e4e0f at mountpoint /dev/vdb on host None. Sep 18 23:55:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-747d346d-228a-4265-a8ed-e8e18d8c7a22 tempest-VolumesActionsTest-1771057458 None] Attach volume completed successfully. Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-747d346d-228a-4265-a8ed-e8e18d8c7a22 tempest-VolumesActionsTest-1771057458 None] Lock "cinder-8d78a3ba-a690-45d2-ab7b-2659edc04b46" released by "attach_volume" :: held 0.211s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:46 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.386s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:55:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Deleted volume successfully. Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-57fbae0c-2597-4dc6-9229-f5871166d7a3 tempest-VolumesTransfersV357Test-1958341150 None] Lock "cinder-2214dc98-303d-4ba7-b036-aac2c681e4a3-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD, size 20.69 MB, duration 9.18 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 23:55:46 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Image download 20.69 MB at 2.25 MB/s Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fa9cee-7198-4c24-90f5-4a1b326c4d1c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:46 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD Sep 18 23:55:46 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:47 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD" returned: 0 in 0.497s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Temporary image 90e1840c-3afd-4f27-9c89-d7a457baa3ff is fetched for user 179aeeed80414ee28029600767390b29. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[00128980-2042-4e89-b488-e495edd504ab]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:47 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD Sep 18 23:55:47 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a2ff42e5-8d7f-4903-80c8-b12495830c58 tempest-VolumesActionsTest-1818346497 None] Terminate volume connection completed successfully. Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Flow 'volume_create_manager' (1d116322-bf45-4e39-b686-6cfb7e9acf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1f94fb-2398-4381-9394-1e3a8cc2c89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1f94fb-2398-4381-9394-1e3a8cc2c89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1171524651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0de446-01e8-4638-ac37-985c03ecfed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72341e2acfcf462d9494b25f9d508389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:47Z,use_quota=True,user_id='308eeaefce134c9a872276c42ebf8ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b1f54c-47bf-424f-a834-6d05e749393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b1f54c-47bf-424f-a834-6d05e749393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddbff36-ae39-4842-818f-41f74752d38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddbff36-ae39-4842-818f-41f74752d38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c0de446-01e8-4638-ac37-985c03ecfed8', 'volume_name': 'volume-8c0de446-01e8-4638-ac37-985c03ecfed8', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d103d1ea-2901-4297-b33c-16024140a235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d103d1ea-2901-4297-b33c-16024140a235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab178cc1-0590-46d3-afdf-31392d340391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:47 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Volume 8c0de446-01e8-4638-ac37-985c03ecfed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c0de446-01e8-4638-ac37-985c03ecfed8', 'volume_size': 1} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1171524651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0de446-01e8-4638-ac37-985c03ecfed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72341e2acfcf462d9494b25f9d508389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:47Z,use_quota=True,user_id='308eeaefce134c9a872276c42ebf8ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Creating volume 8c0de446-01e8-4638-ac37-985c03ecfed8 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:55:47 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c0de446-01e8-4638-ac37-985c03ecfed8 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a2ff42e5-8d7f-4903-80c8-b12495830c58 tempest-VolumesActionsTest-1818346497 None] Acquiring lock "cinder-8d78a3ba-a690-45d2-ab7b-2659edc04b46-detach_volume" by "detach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a2ff42e5-8d7f-4903-80c8-b12495830c58 tempest-VolumesActionsTest-1818346497 None] Lock "cinder-8d78a3ba-a690-45d2-ab7b-2659edc04b46-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:47 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c0de446-01e8-4638-ac37-985c03ecfed8 1073741824 Sep 18 23:55:47 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a2ff42e5-8d7f-4903-80c8-b12495830c58 tempest-VolumesActionsTest-1818346497 None] Detaching volume 8d78a3ba-a690-45d2-ab7b-2659edc04b46 from instance 8d7abbe8-f3fc-45f7-83d3-4d7eec7e4e0f. Sep 18 23:55:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a2ff42e5-8d7f-4903-80c8-b12495830c58 tempest-VolumesActionsTest-1818346497 None] Detach volume completed successfully. Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a2ff42e5-8d7f-4903-80c8-b12495830c58 tempest-VolumesActionsTest-1818346497 None] Lock "cinder-8d78a3ba-a690-45d2-ab7b-2659edc04b46-detach_volume" released by "detach_volume" :: held 0.154s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:47 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD" returned: 0 in 0.582s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5fb01435-df7b-4252-8781-31ae72f3707d tempest-VolumesActionsTest-1771057458 None] Acquiring lock "cinder-8d78a3ba-a690-45d2-ab7b-2659edc04b46-detach_volume" by "detach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5fb01435-df7b-4252-8781-31ae72f3707d tempest-VolumesActionsTest-1771057458 None] Lock "cinder-8d78a3ba-a690-45d2-ab7b-2659edc04b46-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5fb01435-df7b-4252-8781-31ae72f3707d tempest-VolumesActionsTest-1771057458 None] Volume detach called, but volume not attached. Sep 18 23:55:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5fb01435-df7b-4252-8781-31ae72f3707d tempest-VolumesActionsTest-1771057458 None] Lock "cinder-8d78a3ba-a690-45d2-ab7b-2659edc04b46-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:48 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c0de446-01e8-4638-ac37-985c03ecfed8 1073741824" returned: 0 in 0.837s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c0de446-01e8-4638-ac37-985c03ecfed8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Acquiring lock "cinder-8d78a3ba-a690-45d2-ab7b-2659edc04b46-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:48 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c0de446-01e8-4638-ac37-985c03ecfed8 Sep 18 23:55:48 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Lock "cinder-8d78a3ba-a690-45d2-ab7b-2659edc04b46-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Acquiring lock "cinder-quobyte-8d78a3ba-a690-45d2-ab7b-2659edc04b46" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Lock "cinder-quobyte-8d78a3ba-a690-45d2-ab7b-2659edc04b46" acquired by "delete_volume" :: waited 0.045s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:48 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc01228-6e6c-4a58-abe8-c4bb961e470f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:49 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46 Sep 18 23:55:49 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:49 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c0de446-01e8-4638-ac37-985c03ecfed8" returned: 0 in 0.493s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.194s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1202098838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdee686-257e-4473-aeea-695d6b6cda2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a3448306d34ac8b3e0b3429b7e9572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:36Z,use_quota=True,user_id='179aeeed80414ee28029600767390b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42fc5c82-6aad-45a9-85e6-4dc612e1d830),volume_type_id=42fc5c82-6aad-45a9-85e6-4dc612e1d830)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Creating volume 6bdee686-257e-4473-aeea-695d6b6cda2e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:55:49 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:49 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e 1073741824 Sep 18 23:55:49 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab178cc1-0590-46d3-afdf-31392d340391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c0de446-01e8-4638-ac37-985c03ecfed8', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8319afbe-01f1-45c0-94a6-341dec45ab94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:49 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Volume volume-8c0de446-01e8-4638-ac37-985c03ecfed8 (8c0de446-01e8-4638-ac37-985c03ecfed8): created successfully Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8319afbe-01f1-45c0-94a6-341dec45ab94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Flow 'volume_create_manager' (1d116322-bf45-4e39-b686-6cfb7e9acf42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-69e587d7-50c3-4d90-ac49-7ffe52aa4557 tempest-VolumesTransfersV357Test-51086446 None] Created volume successfully. Sep 18 23:55:49 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46" returned: 0 in 0.646s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:49 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46 Sep 18 23:55:49 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:49 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8d78a3ba-a690-45d2-ab7b-2659edc04b46" returned: 0 in 0.439s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Lock "cinder-quobyte-8d78a3ba-a690-45d2-ab7b-2659edc04b46" released by "delete_volume" :: held 1.153s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Created reservations ['63c40555-e212-4527-912a-5154c16b85dd', '19f02324-aa1b-4f46-adf9-eb4d4911acbb', 'beec0eab-c576-46e6-8e5e-6aa25792cc89', 'a51e4d52-07ff-46d1-b70f-ba35ded97b87'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:55:50 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e 1073741824" returned: 0 in 0.927s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:50 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e Sep 18 23:55:50 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Acquiring lock "cinder-8c0de446-01e8-4638-ac37-985c03ecfed8-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:50 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:55:50 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Lock "cinder-8c0de446-01e8-4638-ac37-985c03ecfed8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Acquiring lock "cinder-quobyte-8c0de446-01e8-4638-ac37-985c03ecfed8" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Lock "cinder-quobyte-8c0de446-01e8-4638-ac37-985c03ecfed8" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd1b6fd-e074-4692-883f-fce9a880d65a]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c0de446-01e8-4638-ac37-985c03ecfed8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:50 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e" returned: 0 in 0.359s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:50 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c0de446-01e8-4638-ac37-985c03ecfed8 Sep 18 23:55:50 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:50 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:55:50 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Deleted volume successfully. Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Attempting download of 90e1840c-3afd-4f27-9c89-d7a457baa3ff ((None, [{'url': 'file:///opt/stack/data/glance/images/90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'metadata': {}}])) to volume 6bdee686-257e-4473-aeea-695d6b6cda2e. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0eed7f16-3310-4721-8d02-df6a67dbc74e tempest-VolumesActionsTest-1771057458 None] Lock "cinder-8d78a3ba-a690-45d2-ab7b-2659edc04b46-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f6c013-c626-4e0a-8492-003c193985b8]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90e1840c-3afd-4f27-9c89-d7a457baa3ff_2lga3lo9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:50 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90e1840c-3afd-4f27-9c89-d7a457baa3ff_2lga3lo9 Sep 18 23:55:50 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:50 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c0de446-01e8-4638-ac37-985c03ecfed8" returned: 0 in 0.479s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c0de446-01e8-4638-ac37-985c03ecfed8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:50 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c0de446-01e8-4638-ac37-985c03ecfed8 Sep 18 23:55:50 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:50 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90e1840c-3afd-4f27-9c89-d7a457baa3ff_2lga3lo9" returned: 0 in 0.377s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90e1840c-3afd-4f27-9c89-d7a457baa3ff_2lga3lo9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:51 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90e1840c-3afd-4f27-9c89-d7a457baa3ff_2lga3lo9 Sep 18 23:55:51 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:51 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c0de446-01e8-4638-ac37-985c03ecfed8" returned: 0 in 0.379s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Lock "cinder-quobyte-8c0de446-01e8-4638-ac37-985c03ecfed8" released by "delete_volume" :: held 0.910s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Created reservations ['8f72b724-f984-4773-99ff-b68e930cd9f2', '5a63ad64-8401-4054-b21a-e24e82216e9b', '14266011-ed22-449e-8afd-8db9d56b1a3d', '7e676fac-47d8-4e03-a2c7-4ec7741b381f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:55:51 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90e1840c-3afd-4f27-9c89-d7a457baa3ff_2lga3lo9" returned: 1 in 0.412s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90e1840c-3afd-4f27-9c89-d7a457baa3ff_2lga3lo9' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aadd90-75ac-4a36-9c36-f21ebf0a8ac5]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:51 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:55:51 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:51 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD Sep 18 23:55:51 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:51 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.412s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:55:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Deleted volume successfully. Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4a7abe74-aedf-4a68-8a09-52e4431e9e3b tempest-VolumesTransfersV357Test-1958341150 None] Lock "cinder-8c0de446-01e8-4638-ac37-985c03ecfed8-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:51 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] 90e1840c-3afd-4f27-9c89-d7a457baa3ff was qcow2, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 23:55:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:51 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e Sep 18 23:55:51 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:54 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e" returned: 0 in 2.363s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90e1840c-3afd-4f27-9c89-d7a457baa3ff_36b0uj_sdevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:55:54 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Converted 112.00 MB image at 47.37 MB/s Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:54 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e 1G Sep 18 23:55:54 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Flow 'volume_create_manager' (1ce303ad-d322-4ac2-bf5c-8f116ff61f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f321da03-4d16-4082-8361-3aa5ee3a33f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f321da03-4d16-4082-8361-3aa5ee3a33f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1229782553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3abb69-1abe-40b3-b218-8adda746315c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284acdbf9c4a41b3ac50d17e54fdafb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:54Z,use_quota=True,user_id='bdc220816d6045a0bf4e949750bee31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6f87a7-2dfc-4ebd-a65e-a51a4d6a9f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6f87a7-2dfc-4ebd-a65e-a51a4d6a9f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070ed667-bc7d-48b9-b3cb-d98189444e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070ed667-bc7d-48b9-b3cb-d98189444e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f3abb69-1abe-40b3-b218-8adda746315c', 'volume_name': 'volume-9f3abb69-1abe-40b3-b218-8adda746315c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a3c76e-7712-4df8-b779-20b05d97fad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a3c76e-7712-4df8-b779-20b05d97fad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ca8c07-fd49-4590-be20-c78f3a12214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Volume 9f3abb69-1abe-40b3-b218-8adda746315c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f3abb69-1abe-40b3-b218-8adda746315c', 'volume_size': 1} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1229782553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3abb69-1abe-40b3-b218-8adda746315c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284acdbf9c4a41b3ac50d17e54fdafb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:54Z,use_quota=True,user_id='bdc220816d6045a0bf4e949750bee31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Creating volume 9f3abb69-1abe-40b3-b218-8adda746315c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:55:54 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f3abb69-1abe-40b3-b218-8adda746315c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:54 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f3abb69-1abe-40b3-b218-8adda746315c 1073741824 Sep 18 23:55:54 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:54 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e 1G" returned: 0 in 0.394s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Downloaded image 90e1840c-3afd-4f27-9c89-d7a457baa3ff ((None, [{'url': 'file:///opt/stack/data/glance/images/90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'metadata': {}}])) to volume 6bdee686-257e-4473-aeea-695d6b6cda2e successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Temporary image 90e1840c-3afd-4f27-9c89-d7a457baa3ff for user 179aeeed80414ee28029600767390b29 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Marking volume 6bdee686-257e-4473-aeea-695d6b6cda2e as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Copying metadata from image 90e1840c-3afd-4f27-9c89-d7a457baa3ff to 6bdee686-257e-4473-aeea-695d6b6cda2e. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Creating volume glance metadata for volume 6bdee686-257e-4473-aeea-695d6b6cda2e backed by image 90e1840c-3afd-4f27-9c89-d7a457baa3ff with: {'image_id': '90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'image_name': 'tempest-scenario-img--276090128', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63be5b85-02fd-43a2-be55-7e503ade55e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bdee686-257e-4473-aeea-695d6b6cda2e', 'volume_size': 1, 'image_id': '90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--276090128', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83a3448306d34ac8b3e0b3429b7e9572', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90e1840c-3afd-4f27-9c89-d7a457baa3ff', 'created_at': datetime.datetime(2026, 9, 18, 21, 55, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 55, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90e1840c-3afd-4f27-9c89-d7a457baa3ff/file', 'properties': {}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e249e906-5fa1-4aa3-b11a-120867a69b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Volume volume-6bdee686-257e-4473-aeea-695d6b6cda2e (6bdee686-257e-4473-aeea-695d6b6cda2e): created successfully Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e249e906-5fa1-4aa3-b11a-120867a69b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Flow 'volume_create_manager' (00fef8cd-32a2-4cc4-8d12-04b99057338e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:54 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4ca9a0e7-f480-48db-abc9-67ab8ee7fcb4 tempest-TestInstancesWithCinderVolumes-223214885 None] Created volume successfully. Sep 18 23:55:55 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f3abb69-1abe-40b3-b218-8adda746315c 1073741824" returned: 0 in 0.604s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f3abb69-1abe-40b3-b218-8adda746315c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:55 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f3abb69-1abe-40b3-b218-8adda746315c Sep 18 23:55:55 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:55 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f3abb69-1abe-40b3-b218-8adda746315c" returned: 0 in 0.300s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:55:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ca8c07-fd49-4590-be20-c78f3a12214e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f3abb69-1abe-40b3-b218-8adda746315c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797f7af0-3287-47ed-b926-449fa030b9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Volume volume-9f3abb69-1abe-40b3-b218-8adda746315c (9f3abb69-1abe-40b3-b218-8adda746315c): created successfully Sep 18 23:55:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797f7af0-3287-47ed-b926-449fa030b9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Flow 'volume_create_manager' (1ce303ad-d322-4ac2-bf5c-8f116ff61f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-124c896c-7cb0-48f5-a8d6-d097a63e8ace tempest-VolumesActionsTest-1771057458 None] Created volume successfully. Sep 18 23:55:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Acquiring lock "cinder-9f3abb69-1abe-40b3-b218-8adda746315c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Lock "cinder-9f3abb69-1abe-40b3-b218-8adda746315c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Acquiring lock "cinder-quobyte-9f3abb69-1abe-40b3-b218-8adda746315c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:55:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Lock "cinder-quobyte-9f3abb69-1abe-40b3-b218-8adda746315c" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:55:56 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aa0208-756d-401e-85b8-e3b24d03c905]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:55:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f3abb69-1abe-40b3-b218-8adda746315c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:57 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f3abb69-1abe-40b3-b218-8adda746315c Sep 18 23:55:57 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:57 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f3abb69-1abe-40b3-b218-8adda746315c" returned: 0 in 0.570s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f3abb69-1abe-40b3-b218-8adda746315c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:57 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f3abb69-1abe-40b3-b218-8adda746315c Sep 18 23:55:57 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:57 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9f3abb69-1abe-40b3-b218-8adda746315c" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Lock "cinder-quobyte-9f3abb69-1abe-40b3-b218-8adda746315c" released by "delete_volume" :: held 0.934s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:57 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Created reservations ['aa9c2720-b183-48ec-8c2e-a734a3d63364', '2a000fb5-a6d0-4371-8b42-c60b89c024ec', '4c5ef65a-dc26-4fbf-886c-5f62cc670d6e', '8e66c15e-684e-46f8-8d5b-59ee1392e791'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:55:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:58 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:55:58 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:58 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.462s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:55:58 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:55:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Deleted volume successfully. Sep 18 23:55:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-17b2c956-4c40-43ce-827f-6b0ea70ba187 tempest-VolumesActionsTest-1818346497 None] Lock "cinder-9f3abb69-1abe-40b3-b218-8adda746315c-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:55:58 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Flow 'volume_create_manager' (062b4c64-56b1-4563-9486-40e0f7900185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4553e57e-27cc-4225-b9a7-2d4b64890892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4553e57e-27cc-4225-b9a7-2d4b64890892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-441136690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0871036-8ad2-4f0c-adb2-1c1b75517a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284acdbf9c4a41b3ac50d17e54fdafb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:59Z,use_quota=True,user_id='bdc220816d6045a0bf4e949750bee31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32fb886-5cf8-4c8b-8c82-5e777bff232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32fb886-5cf8-4c8b-8c82-5e777bff232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2819378-978b-4673-8a7e-ad598290fd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2819378-978b-4673-8a7e-ad598290fd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0871036-8ad2-4f0c-adb2-1c1b75517a10', 'volume_name': 'volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d58959-3629-4808-a593-061b26aa55cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d58959-3629-4808-a593-061b26aa55cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd07f1ad-cce7-499c-b5df-84e8873ce3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:55:59 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Volume b0871036-8ad2-4f0c-adb2-1c1b75517a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10', 'volume_size': 1} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-441136690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0871036-8ad2-4f0c-adb2-1c1b75517a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284acdbf9c4a41b3ac50d17e54fdafb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:55:59Z,use_quota=True,user_id='bdc220816d6045a0bf4e949750bee31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Creating volume b0871036-8ad2-4f0c-adb2-1c1b75517a10 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:55:59 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c87645a6-886c-48bd-83d5-5b2efb76ec8c req-761c78e3-44ba-4a48-937a-91064a040686 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:55:59 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10 1073741824 Sep 18 23:55:59 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:55:59 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Sep 18 23:55:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10 1073741824" returned: 0 in 0.829s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:00 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10 Sep 18 23:56:00 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-2fcb9a53-3466-48b8-b21e-8ce7d2842eff req-3ea588e0-b1c0-4863-b4a1-39e5bf981e82 tempest-TestStampPattern-1014361966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:00 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c87645a6-886c-48bd-83d5-5b2efb76ec8c req-761c78e3-44ba-4a48-937a-91064a040686 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.167s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c87645a6-886c-48bd-83d5-5b2efb76ec8c req-761c78e3-44ba-4a48-937a-91064a040686 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-2fcb9a53-3466-48b8-b21e-8ce7d2842eff req-3ea588e0-b1c0-4863-b4a1-39e5bf981e82 tempest-TestStampPattern-1014361966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.207s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd07f1ad-cce7-499c-b5df-84e8873ce3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb7ab8a-74fc-4ee7-bf34-3f9823c8313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-2fcb9a53-3466-48b8-b21e-8ce7d2842eff req-3ea588e0-b1c0-4863-b4a1-39e5bf981e82 tempest-TestStampPattern-1014361966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Volume volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10 (b0871036-8ad2-4f0c-adb2-1c1b75517a10): created successfully Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb7ab8a-74fc-4ee7-bf34-3f9823c8313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Flow 'volume_create_manager' (062b4c64-56b1-4563-9486-40e0f7900185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8e89a5dd-b4bd-435b-b13c-6013747fc492 tempest-VolumesActionsTest-1771057458 None] Created volume successfully. Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-c87645a6-886c-48bd-83d5-5b2efb76ec8c req-761c78e3-44ba-4a48-937a-91064a040686 tempest-TestInstancesWithCinderVolumes-223214885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-6bdee686-257e-4473-aeea-695d6b6cda2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3a9c892-dfb4-4ae2-a87d-40a76f825337', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:56:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2fcb9a53-3466-48b8-b21e-8ce7d2842eff req-3ea588e0-b1c0-4863-b4a1-39e5bf981e82 tempest-TestStampPattern-1014361966 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b40a8284-c440-408c-a63e-3993df52eae8', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:56:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-c87645a6-886c-48bd-83d5-5b2efb76ec8c req-761c78e3-44ba-4a48-937a-91064a040686 tempest-TestInstancesWithCinderVolumes-223214885 None] attachment_update completed successfully. Sep 18 23:56:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-2fcb9a53-3466-48b8-b21e-8ce7d2842eff req-3ea588e0-b1c0-4863-b4a1-39e5bf981e82 tempest-TestStampPattern-1014361966 None] attachment_update completed successfully. Sep 18 23:56:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Acquiring lock "cinder-b0871036-8ad2-4f0c-adb2-1c1b75517a10-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Lock "cinder-b0871036-8ad2-4f0c-adb2-1c1b75517a10-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Acquiring lock "cinder-quobyte-b0871036-8ad2-4f0c-adb2-1c1b75517a10" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Lock "cinder-quobyte-b0871036-8ad2-4f0c-adb2-1c1b75517a10" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc72e583-13f4-4d48-92ed-c5e363d35a94]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:01 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10 Sep 18 23:56:01 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:01 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:56:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Flow 'volume_create_manager' (01ce0517-0d32-4377-89b8-f5a85e29af41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa87738-68c9-40be-ad09-a249d75bc03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa87738-68c9-40be-ad09-a249d75bc03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-671469047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f6b794-9ce1-4f94-b048-f146d0f6d928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b8b7acc3d745c19dca8a83d65c39f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:02Z,use_quota=True,user_id='aec26965a43b4ec696bda9f70e125143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7a72dd-fe96-428d-ac49-f8a2f4316e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7a72dd-fe96-428d-ac49-f8a2f4316e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a53b920-d21c-4328-b06a-0140ee00bdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 23:56:02 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10" returned: 0 in 0.624s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:02 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10 Sep 18 23:56:02 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a53b920-d21c-4328-b06a-0140ee00bdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '13f6b794-9ce1-4f94-b048-f146d0f6d928', 'volume_name': 'volume-13f6b794-9ce1-4f94-b048-f146d0f6d928', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d156b42-887b-4eee-afc5-f3343a76e538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d156b42-887b-4eee-afc5-f3343a76e538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c0224f-44cb-47ec-ac27-1e5739acaf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Volume 13f6b794-9ce1-4f94-b048-f146d0f6d928: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-13f6b794-9ce1-4f94-b048-f146d0f6d928', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 23:56:02 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Trying to clone 13f6b794-9ce1-4f94-b048-f146d0f6d928 from image 4b54cd3f-793e-47ca-910a-79fe5da0114d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 23:56:03 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b0871036-8ad2-4f0c-adb2-1c1b75517a10" returned: 0 in 1.021s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Lock "cinder-quobyte-b0871036-8ad2-4f0c-adb2-1c1b75517a10" released by "delete_volume" :: held 1.745s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:03 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Created reservations ['15929c17-de71-40fd-a02b-51e1eeb3592a', '19450f32-9169-4580-8738-fad4a58d3a99', '9f25df14-a0a8-4800-890f-82d220a54ffd', 'f6d1db9d-dca4-4fa2-9785-e3b0dda62ee8'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:56:03 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 23:56:03 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Image download 20.69 MB at 20.69 MB/s Sep 18 23:56:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:03 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:56:03 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3988eee2-0bba-49dc-9363-d71ec98ffc9d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:04 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD Sep 18 23:56:04 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:04 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.515s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:04 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:56:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Deleted volume successfully. Sep 18 23:56:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45af73f-f995-45f1-b820-9e0dc4d109cb tempest-VolumesActionsTest-1818346497 None] Lock "cinder-b0871036-8ad2-4f0c-adb2-1c1b75517a10-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:04 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD" returned: 0 in 0.568s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:04 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Temporary image 4b54cd3f-793e-47ca-910a-79fe5da0114d is fetched for user aec26965a43b4ec696bda9f70e125143. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 23:56:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7472f4d-391f-4824-90cc-17d29956a1f6]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:04 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD Sep 18 23:56:04 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Flow 'volume_create_manager' (804a0550-802c-4dc2-8eb2-81677ce08c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2edd81-bf03-41ab-af55-b99f8918288f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2edd81-bf03-41ab-af55-b99f8918288f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1196817589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84587cd7-fa51-4fa1-9801-2eea84d61324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284acdbf9c4a41b3ac50d17e54fdafb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:05Z,use_quota=True,user_id='bdc220816d6045a0bf4e949750bee31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114580af-c74d-4044-b43b-2e5e56d62f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114580af-c74d-4044-b43b-2e5e56d62f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5249d80e-e60e-432b-9e6d-63ac49be419e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5249d80e-e60e-432b-9e6d-63ac49be419e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84587cd7-fa51-4fa1-9801-2eea84d61324', 'volume_name': 'volume-84587cd7-fa51-4fa1-9801-2eea84d61324', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24986cbb-477b-4981-a977-0dcba226266e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24986cbb-477b-4981-a977-0dcba226266e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba52cd7-021f-48ad-ba80-479d57365dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Volume 84587cd7-fa51-4fa1-9801-2eea84d61324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84587cd7-fa51-4fa1-9801-2eea84d61324', 'volume_size': 1} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1196817589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84587cd7-fa51-4fa1-9801-2eea84d61324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284acdbf9c4a41b3ac50d17e54fdafb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:05Z,use_quota=True,user_id='bdc220816d6045a0bf4e949750bee31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Creating volume 84587cd7-fa51-4fa1-9801-2eea84d61324 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:56:05 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84587cd7-fa51-4fa1-9801-2eea84d61324 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:05 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84587cd7-fa51-4fa1-9801-2eea84d61324 1073741824 Sep 18 23:56:05 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:05 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD" returned: 0 in 0.735s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:05 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84587cd7-fa51-4fa1-9801-2eea84d61324 1073741824" returned: 0 in 0.643s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=108,cinder:DELETE=8,cinder:SELECT=98,cinder:INSERT=24 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84587cd7-fa51-4fa1-9801-2eea84d61324 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:05 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84587cd7-fa51-4fa1-9801-2eea84d61324 Sep 18 23:56:05 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:06 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84587cd7-fa51-4fa1-9801-2eea84d61324" returned: 0 in 0.376s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.899s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-671469047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f6b794-9ce1-4f94-b048-f146d0f6d928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b8b7acc3d745c19dca8a83d65c39f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:02Z,use_quota=True,user_id='aec26965a43b4ec696bda9f70e125143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Creating volume 13f6b794-9ce1-4f94-b048-f146d0f6d928 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:56:06 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba52cd7-021f-48ad-ba80-479d57365dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84587cd7-fa51-4fa1-9801-2eea84d61324', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e80e58-0bd2-458c-a0f9-e3b0b314c40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:06 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 1073741824 Sep 18 23:56:06 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:06 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Volume volume-84587cd7-fa51-4fa1-9801-2eea84d61324 (84587cd7-fa51-4fa1-9801-2eea84d61324): created successfully Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e80e58-0bd2-458c-a0f9-e3b0b314c40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Flow 'volume_create_manager' (804a0550-802c-4dc2-8eb2-81677ce08c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:06 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-47fe175f-7fa5-4b2a-9057-280e0ac71409 tempest-VolumesActionsTest-1771057458 None] Created volume successfully. Sep 18 23:56:07 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 1073741824" returned: 0 in 0.889s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:07 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 Sep 18 23:56:07 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-258d76a0-6617-466a-b8c4-b8dddd3eff30 req-4d90cdc1-9f60-4a4e-a686-618cc77c7310 tempest-TestStampPattern-1014361966 None] Terminate volume connection completed successfully. Sep 18 23:56:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-258d76a0-6617-466a-b8c4-b8dddd3eff30 req-4d90cdc1-9f60-4a4e-a686-618cc77c7310 tempest-TestStampPattern-1014361966 None] Deleting attachment b40a8284-c440-408c-a63e-3993df52eae8. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:56:07 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928" returned: 0 in 0.477s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:56:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:07 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Attempting download of 4b54cd3f-793e-47ca-910a-79fe5da0114d ((None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}])) to volume 13f6b794-9ce1-4f94-b048-f146d0f6d928. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 23:56:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Acquiring lock "cinder-84587cd7-fa51-4fa1-9801-2eea84d61324-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Lock "cinder-84587cd7-fa51-4fa1-9801-2eea84d61324-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e67b590-cfbf-4e98-ac46-562af8f2f7ba]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_hmw7s6gi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Acquiring lock "cinder-quobyte-84587cd7-fa51-4fa1-9801-2eea84d61324" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Lock "cinder-quobyte-84587cd7-fa51-4fa1-9801-2eea84d61324" acquired by "delete_volume" :: waited 0.055s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa67011-142a-48be-b5ee-a7004d6da534]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84587cd7-fa51-4fa1-9801-2eea84d61324 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:08 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_hmw7s6gi Sep 18 23:56:08 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:08 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84587cd7-fa51-4fa1-9801-2eea84d61324 Sep 18 23:56:08 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:08 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_hmw7s6gi" returned: 0 in 0.730s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_hmw7s6gi {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] Creating offline snapshot 381a6224-201e-40f2-9447-6153177f9c97 of volume 5425c925-4202-4ff0-a7e0-4f2539cdaa39 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:56:08 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84587cd7-fa51-4fa1-9801-2eea84d61324" returned: 0 in 0.682s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84587cd7-fa51-4fa1-9801-2eea84d61324 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00b5cde-29b4-4269-b36e-4f1320440e26]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:08 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84587cd7-fa51-4fa1-9801-2eea84d61324 Sep 18 23:56:08 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:08 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_hmw7s6gi Sep 18 23:56:08 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:09 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 Sep 18 23:56:09 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:09 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_hmw7s6gi" returned: 1 in 0.640s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_hmw7s6gi' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[124dab76-46ef-4196-a077-2b18b926f442]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:09 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84587cd7-fa51-4fa1-9801-2eea84d61324" returned: 0 in 0.596s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Lock "cinder-quobyte-84587cd7-fa51-4fa1-9801-2eea84d61324" released by "delete_volume" :: held 1.350s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:09 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39" returned: 0 in 0.666s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:09 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 1G Sep 18 23:56:09 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Created reservations ['46f93863-da8c-4abb-9667-21bbec27dac9', '8f140eb7-be24-45ff-89ce-fae41470f691', 'e0368d6c-b867-4e92-83dd-b262f2904089', '0475751b-b366-4561-9b12-530ea2d44dc5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:56:09 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD Sep 18 23:56:09 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:09 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:09 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:56:09 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD" returned: 0 in 0.595s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] 4b54cd3f-793e-47ca-910a-79fe5da0114d was qcow2, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 23:56:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:10 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 Sep 18 23:56:10 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:10 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.568s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:10 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:56:10 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Deleted volume successfully. Sep 18 23:56:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 1G" returned: 0 in 1.010s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b64d02eb-f461-48c9-a3e0-17a507f9863b tempest-VolumesActionsTest-1818346497 None] Lock "cinder-84587cd7-fa51-4fa1-9801-2eea84d61324-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:10 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 Sep 18 23:56:10 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:11 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97" returned: 0 in 1.015s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:11 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 is being set with open permissions: ugo+rw Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:11 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 Sep 18 23:56:11 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Flow 'volume_create_manager' (7860d590-84f3-4600-9b6c-374a6e271693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b39e3b3-750e-4e9a-b469-c5ea6389c349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b39e3b3-750e-4e9a-b469-c5ea6389c349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-404446950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3943a95c-5648-4987-9a0b-96fc6f3284d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284acdbf9c4a41b3ac50d17e54fdafb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:12Z,use_quota=True,user_id='bdc220816d6045a0bf4e949750bee31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179c7fd7-8a6b-462a-acea-977c9b41ef18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179c7fd7-8a6b-462a-acea-977c9b41ef18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c912ac7-bfd6-4166-9732-f5b43a46674e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c912ac7-bfd6-4166-9732-f5b43a46674e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3943a95c-5648-4987-9a0b-96fc6f3284d4', 'volume_name': 'volume-3943a95c-5648-4987-9a0b-96fc6f3284d4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe926f31-8d6e-4ea2-b4e6-5f6909ca6fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe926f31-8d6e-4ea2-b4e6-5f6909ca6fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4703fb-70ed-47ae-82ee-9ae674efe320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Volume 3943a95c-5648-4987-9a0b-96fc6f3284d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3943a95c-5648-4987-9a0b-96fc6f3284d4', 'volume_size': 1} Sep 18 23:56:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:12 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97" returned: 0 in 0.644s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:12 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.info Sep 18 23:56:12 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:12 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.info" returned: 0 in 0.330s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:12 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.info is being set with open permissions: ugo+rw Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:12 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.info Sep 18 23:56:12 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:12 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.info" returned: 0 in 0.315s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.158s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.967s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-404446950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3943a95c-5648-4987-9a0b-96fc6f3284d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284acdbf9c4a41b3ac50d17e54fdafb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:12Z,use_quota=True,user_id='bdc220816d6045a0bf4e949750bee31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Creating volume 3943a95c-5648-4987-9a0b-96fc6f3284d4 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:56:12 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:56:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3943a95c-5648-4987-9a0b-96fc6f3284d4 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:12 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3943a95c-5648-4987-9a0b-96fc6f3284d4 1073741824 Sep 18 23:56:12 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-12b726fd-33d6-4f3a-9098-9553077372bb tempest-TestStampPattern-1014361966 None] Create snapshot completed successfully Sep 18 23:56:13 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928" returned: 0 in 3.322s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_6sgrlob_devstack@QuobyteHD, size 112.00 MB, duration 3.32 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:56:13 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Converted 112.00 MB image at 33.70 MB/s Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:13 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 1G Sep 18 23:56:13 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:13 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3943a95c-5648-4987-9a0b-96fc6f3284d4 1073741824" returned: 0 in 0.628s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3943a95c-5648-4987-9a0b-96fc6f3284d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:13 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3943a95c-5648-4987-9a0b-96fc6f3284d4 Sep 18 23:56:13 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:13 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 1G" returned: 0 in 0.547s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Downloaded image 4b54cd3f-793e-47ca-910a-79fe5da0114d ((None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}])) to volume 13f6b794-9ce1-4f94-b048-f146d0f6d928 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Temporary image 4b54cd3f-793e-47ca-910a-79fe5da0114d for user aec26965a43b4ec696bda9f70e125143 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Marking volume 13f6b794-9ce1-4f94-b048-f146d0f6d928 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Copying metadata from image 4b54cd3f-793e-47ca-910a-79fe5da0114d to 13f6b794-9ce1-4f94-b048-f146d0f6d928. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Creating volume glance metadata for volume 13f6b794-9ce1-4f94-b048-f146d0f6d928 backed by image 4b54cd3f-793e-47ca-910a-79fe5da0114d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 23:56:13 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3943a95c-5648-4987-9a0b-96fc6f3284d4" returned: 0 in 0.313s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4703fb-70ed-47ae-82ee-9ae674efe320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3943a95c-5648-4987-9a0b-96fc6f3284d4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0bf80aa-9a97-47e0-97e8-3b4647f3a313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:13 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Volume volume-3943a95c-5648-4987-9a0b-96fc6f3284d4 (3943a95c-5648-4987-9a0b-96fc6f3284d4): created successfully Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0bf80aa-9a97-47e0-97e8-3b4647f3a313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Flow 'volume_create_manager' (7860d590-84f3-4600-9b6c-374a6e271693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9e1e0928-e25d-4a29-b1c8-e5d1bf365c62 tempest-VolumesActionsTest-1771057458 None] Created volume successfully. Sep 18 23:56:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c0224f-44cb-47ec-ac27-1e5739acaf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f6b794-9ce1-4f94-b048-f146d0f6d928', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237564ae-d77e-4c50-ab3c-64505cfe3a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Volume volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 (13f6b794-9ce1-4f94-b048-f146d0f6d928): created successfully Sep 18 23:56:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237564ae-d77e-4c50-ab3c-64505cfe3a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Flow 'volume_create_manager' (01ce0517-0d32-4377-89b8-f5a85e29af41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ffe56016-d501-4224-8d53-98cc23610a34 tempest-VolumesExtendTest-920701055 None] Created volume successfully. Sep 18 23:56:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8e8fedc3-5752-49e4-ae4d-a8ef5bb6e5b1 tempest-VolumesExtendTest-920701055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8e8fedc3-5752-49e4-ae4d-a8ef5bb6e5b1 tempest-VolumesExtendTest-920701055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0ff239-5576-4ce3-9dc4-80a0334bb03d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8e8fedc3-5752-49e4-ae4d-a8ef5bb6e5b1 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:14 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 Sep 18 23:56:14 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Acquiring lock "cinder-3943a95c-5648-4987-9a0b-96fc6f3284d4-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Lock "cinder-3943a95c-5648-4987-9a0b-96fc6f3284d4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Acquiring lock "cinder-quobyte-3943a95c-5648-4987-9a0b-96fc6f3284d4" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Lock "cinder-quobyte-3943a95c-5648-4987-9a0b-96fc6f3284d4" acquired by "delete_volume" :: waited 0.041s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6471a00-7ba0-44ee-bd6b-78334e678563]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3943a95c-5648-4987-9a0b-96fc6f3284d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:15 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3943a95c-5648-4987-9a0b-96fc6f3284d4 Sep 18 23:56:15 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:15 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8e8fedc3-5752-49e4-ae4d-a8ef5bb6e5b1 tempest-VolumesExtendTest-920701055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928" returned: 0 in 0.824s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8e8fedc3-5752-49e4-ae4d-a8ef5bb6e5b1 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 2G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8e8fedc3-5752-49e4-ae4d-a8ef5bb6e5b1 tempest-VolumesExtendTest-920701055 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 2G" returned: 0 in 0.202s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8e8fedc3-5752-49e4-ae4d-a8ef5bb6e5b1 tempest-VolumesExtendTest-920701055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.098s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8e8fedc3-5752-49e4-ae4d-a8ef5bb6e5b1 tempest-VolumesExtendTest-920701055 None] Extend volume completed successfully. Sep 18 23:56:15 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3943a95c-5648-4987-9a0b-96fc6f3284d4" returned: 0 in 0.712s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3943a95c-5648-4987-9a0b-96fc6f3284d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:15 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3943a95c-5648-4987-9a0b-96fc6f3284d4 Sep 18 23:56:15 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:16 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3943a95c-5648-4987-9a0b-96fc6f3284d4" returned: 0 in 0.508s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Lock "cinder-quobyte-3943a95c-5648-4987-9a0b-96fc6f3284d4" released by "delete_volume" :: held 1.303s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:16 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Created reservations ['bac064f1-0895-44b5-8590-c8cc16ae5a4e', '9c901077-3f6c-453b-b7a2-af4b559185a0', 'a75be241-19ac-437c-b597-43a27f32ac0e', '3fb191d4-4c07-4294-9780-13d00ee46f72'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:56:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:16 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:56:16 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:16 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.301s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:16 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:56:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Deleted volume successfully. Sep 18 23:56:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5af7e1e3-a583-4b0d-9c7f-77c8de7b93f5 tempest-VolumesActionsTest-1818346497 None] Lock "cinder-3943a95c-5648-4987-9a0b-96fc6f3284d4-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Acquiring lock "cinder-13f6b794-9ce1-4f94-b048-f146d0f6d928-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Lock "cinder-13f6b794-9ce1-4f94-b048-f146d0f6d928-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Acquiring lock "cinder-quobyte-13f6b794-9ce1-4f94-b048-f146d0f6d928" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Lock "cinder-quobyte-13f6b794-9ce1-4f94-b048-f146d0f6d928" acquired by "delete_volume" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:17 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[17947027-c3ca-44b5-b539-8683d3101355]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:17 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 Sep 18 23:56:17 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:17 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928" returned: 0 in 0.526s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:17 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:56:17 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928 Sep 18 23:56:17 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Flow 'volume_create_manager' (8c021459-b77c-4d4e-9fb4-78b670cff9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a635b7-884a-4d25-894e-256f9b53fe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a635b7-884a-4d25-894e-256f9b53fe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-916057935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02bb5e8-49f6-4d00-808e-55a57d65afbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284acdbf9c4a41b3ac50d17e54fdafb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:18Z,use_quota=True,user_id='bdc220816d6045a0bf4e949750bee31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf44bde7-ff5e-482d-a8e5-15c8e7fe3d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf44bde7-ff5e-482d-a8e5-15c8e7fe3d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbaa04c-1f0c-45e5-b6ce-fa99922bcfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbaa04c-1f0c-45e5-b6ce-fa99922bcfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c02bb5e8-49f6-4d00-808e-55a57d65afbb', 'volume_name': 'volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f66501d-af76-48a0-b3fc-8064d4e0c0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f66501d-af76-48a0-b3fc-8064d4e0c0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da85f04-6217-4cbe-9d3f-5be8b196f19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:18 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Volume c02bb5e8-49f6-4d00-808e-55a57d65afbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb', 'volume_size': 1} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-916057935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02bb5e8-49f6-4d00-808e-55a57d65afbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='284acdbf9c4a41b3ac50d17e54fdafb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:18Z,use_quota=True,user_id='bdc220816d6045a0bf4e949750bee31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Creating volume c02bb5e8-49f6-4d00-808e-55a57d65afbb {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:56:18 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:18 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb 1073741824 Sep 18 23:56:18 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:18 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-13f6b794-9ce1-4f94-b048-f146d0f6d928" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Lock "cinder-quobyte-13f6b794-9ce1-4f94-b048-f146d0f6d928" released by "delete_volume" :: held 0.965s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Created reservations ['113d3168-e0bd-4316-85ad-67f4373b1044', '3534a611-af52-40fb-b24c-5f34774f28d3', 'ebc2d32f-c085-4892-b0ab-1b27bece9a87', '6cea4dd8-fef8-429e-8486-0c5020cfcadd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:18 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:56:18 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:18 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb 1073741824" returned: 0 in 0.586s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:18 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.352s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:56:18 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb Sep 18 23:56:18 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Deleted volume successfully. Sep 18 23:56:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aff061da-59ca-40f8-95db-13b262602c00 tempest-VolumesExtendTest-920701055 None] Lock "cinder-13f6b794-9ce1-4f94-b048-f146d0f6d928-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:19 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb" returned: 0 in 0.376s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:56:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da85f04-6217-4cbe-9d3f-5be8b196f19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa80cc6f-8b3c-42ea-8d7d-d79dde1ef153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Volume volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb (c02bb5e8-49f6-4d00-808e-55a57d65afbb): created successfully Sep 18 23:56:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa80cc6f-8b3c-42ea-8d7d-d79dde1ef153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Flow 'volume_create_manager' (8c021459-b77c-4d4e-9fb4-78b670cff9de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d54ee158-bbc0-47a5-af53-b7e957b5457c tempest-VolumesActionsTest-1771057458 None] Created volume successfully. Sep 18 23:56:19 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Flow 'volume_create_manager' (a336d84d-e9ba-4251-a14f-73870fa5ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4c4e68-908a-425f-9328-30aec9e57c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4c4e68-908a-425f-9328-30aec9e57c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1856275604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b8b7acc3d745c19dca8a83d65c39f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:20Z,use_quota=True,user_id='aec26965a43b4ec696bda9f70e125143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b87484-86d5-4f14-b278-63bbf49e8385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b87484-86d5-4f14-b278-63bbf49e8385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96426b8c-3c3a-4398-9188-91b1911270f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96426b8c-3c3a-4398-9188-91b1911270f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe', 'volume_name': 'volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3a480f-a291-4f21-a017-3dde6f35a4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3a480f-a291-4f21-a017-3dde6f35a4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566cf990-32da-4b9a-9f22-ee7f05e1936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Volume 4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe', 'volume_size': 1} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1856275604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b8b7acc3d745c19dca8a83d65c39f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:20Z,use_quota=True,user_id='aec26965a43b4ec696bda9f70e125143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Creating volume 4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:56:20 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:20 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe 1073741824 Sep 18 23:56:20 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:20 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe 1073741824" returned: 0 in 0.672s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:20 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe Sep 18 23:56:20 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Acquiring lock "cinder-c02bb5e8-49f6-4d00-808e-55a57d65afbb-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Lock "cinder-c02bb5e8-49f6-4d00-808e-55a57d65afbb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Acquiring lock "cinder-quobyte-c02bb5e8-49f6-4d00-808e-55a57d65afbb" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Lock "cinder-quobyte-c02bb5e8-49f6-4d00-808e-55a57d65afbb" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d0c0a8-2608-4d3c-832c-63c97af66e3c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:21 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe" returned: 0 in 0.503s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:21 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:21 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566cf990-32da-4b9a-9f22-ee7f05e1936d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baee22a2-4360-4dad-9cbd-ab722fa1961a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Volume volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe (4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe): created successfully Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baee22a2-4360-4dad-9cbd-ab722fa1961a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Flow 'volume_create_manager' (a336d84d-e9ba-4251-a14f-73870fa5ce68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-101a3703-720a-4d74-95a9-387ba0ebb719 tempest-VolumesExtendTest-920701055 None] Created volume successfully. Sep 18 23:56:21 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb Sep 18 23:56:21 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:21 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.379s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:56:21 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb" returned: 0 in 0.501s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:21 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb Sep 18 23:56:21 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:22 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c02bb5e8-49f6-4d00-808e-55a57d65afbb" returned: 0 in 0.351s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Lock "cinder-quobyte-c02bb5e8-49f6-4d00-808e-55a57d65afbb" released by "delete_volume" :: held 0.942s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Created reservations ['8453f419-1636-4f94-b55f-8fc583ded86b', '2ba04d07-5953-4c50-83f1-5036915196b8', 'e45de498-d46d-45d7-858f-3712d84be86f', '5f7a3257-2f32-4f88-982c-9c1e466a94a3'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:22 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:56:22 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] Creating offline snapshot 8410a058-176a-4f6f-bcc7-beaeb13ca5ab of volume 4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c3300f-1171-4209-88db-d432d88e6e05]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:22 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe Sep 18 23:56:22 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:22 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.289s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:56:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Deleted volume successfully. Sep 18 23:56:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e8c2f200-afc2-455f-958e-ca9f7c9471d5 tempest-VolumesActionsTest-1771057458 None] Lock "cinder-c02bb5e8-49f6-4d00-808e-55a57d65afbb-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:23 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe" returned: 0 in 0.507s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:23 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab 1G Sep 18 23:56:23 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Flow 'volume_create_manager' (924ee1d2-117b-4e38-b401-ccd4c5cbab6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb9c896-2698-43ef-ae6d-d042519ec60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb9c896-2698-43ef-ae6d-d042519ec60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1035045810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bacee4ba-b21d-42c8-be0c-c8d7241f5560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e460a3a6990c4774b30a4067d9434b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=381a6224-201e-40f2-9447-6153177f9c97,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:23Z,use_quota=True,user_id='3e545fb1f4e04be7ba891bcc53dbdd44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1701c0da-da4d-462b-beb4-75c7d7155186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1701c0da-da4d-462b-beb4-75c7d7155186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fddd72-2656-47f0-955d-51c353c719c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fddd72-2656-47f0-955d-51c353c719c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bacee4ba-b21d-42c8-be0c-c8d7241f5560', 'volume_name': 'volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560', 'volume_size': 1, 'snapshot_id': '381a6224-201e-40f2-9447-6153177f9c97'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40583e0b-131a-4d22-85ee-2ce0a131e3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40583e0b-131a-4d22-85ee-2ce0a131e3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cddc3f-c93e-4539-98f9-3c663cedc676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Volume bacee4ba-b21d-42c8-be0c-c8d7241f5560: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560', 'volume_size': 1, 'snapshot_id': '381a6224-201e-40f2-9447-6153177f9c97'} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:23 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab 1G" returned: 0 in 0.690s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:23 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab Sep 18 23:56:23 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:24 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab" returned: 0 in 0.404s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:24 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab is being set with open permissions: ugo+rw Sep 18 23:56:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:24 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab Sep 18 23:56:24 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:24 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab" returned: 0 in 0.408s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:24 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.info Sep 18 23:56:24 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:24 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.info" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:24 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.info is being set with open permissions: ugo+rw Sep 18 23:56:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:24 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.info Sep 18 23:56:24 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:25 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.info" returned: 0 in 0.289s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.705s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.867s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Acquiring lock "cinder-quobyte-381a6224-201e-40f2-9447-6153177f9c97-bacee4ba-b21d-42c8-be0c-c8d7241f5560" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Lock "cinder-quobyte-381a6224-201e-40f2-9447-6153177f9c97-bacee4ba-b21d-42c8-be0c-c8d7241f5560" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Creating volume bacee4ba-b21d-42c8-be0c-c8d7241f5560 from snapshot 381a6224-201e-40f2-9447-6153177f9c97 {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Acquiring lock "cinder-quobyte-bacee4ba-b21d-42c8-be0c-c8d7241f5560" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Lock "cinder-quobyte-bacee4ba-b21d-42c8-be0c-c8d7241f5560" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] snapshot: 381a6224-201e-40f2-9447-6153177f9c97, volume: bacee4ba-b21d-42c8-be0c-c8d7241f5560, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 23:56:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-863b435d-7668-4eac-8078-fab1088c6ad0 tempest-VolumesExtendTest-920701055 None] Create snapshot completed successfully Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aaecbf-88d0-4a23-b871-a59ee1d234f9]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:25 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 Sep 18 23:56:25 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c4fbf5f0-6493-4818-a937-a36a6f538932 tempest-VolumesExtendTest-920701055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:25 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97" returned: 0 in 0.554s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a555e3a-6519-4308-843f-fc54c3f16157]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:26 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 Sep 18 23:56:26 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:26 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39" returned: 0 in 0.485s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 23:56:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 23:56:26 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Path /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 23:56:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:26 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560 Sep 18 23:56:26 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:35 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=49,cinder:DELETE=4,cinder:INSERT=14,cinder:SELECT=45 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:56:35 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=134,cinder:SELECT=117,cinder:INSERT=44,cinder:DELETE=15 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:56:37 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560" returned: 0 in 11.449s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:37 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39, size 1024.00 MB, duration 11.45 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:56:37 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Converted 1024.00 MB image at 89.43 MB/s Sep 18 23:56:37 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560 is being set with open permissions: ugo+rw Sep 18 23:56:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:37 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560 Sep 18 23:56:37 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:38 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560" returned: 0 in 0.390s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Lock "cinder-quobyte-bacee4ba-b21d-42c8-be0c-c8d7241f5560" released by "_copy_volume_from_snapshot" :: held 13.051s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Lock "cinder-quobyte-381a6224-201e-40f2-9447-6153177f9c97-bacee4ba-b21d-42c8-be0c-c8d7241f5560" released by "_create_volume_from_snapshot" :: held 13.136s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.167s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c4fbf5f0-6493-4818-a937-a36a6f538932 tempest-VolumesExtendTest-920701055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 12.563s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cddc3f-c93e-4539-98f9-3c663cedc676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560', 'volume_size': 1, 'snapshot_id': '381a6224-201e-40f2-9447-6153177f9c97'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7727e6d4-da06-4870-a265-6df835a9b4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d7326d-4e49-4451-830b-4309ed142e49]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4fbf5f0-6493-4818-a937-a36a6f538932 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:38 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Volume volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560 (bacee4ba-b21d-42c8-be0c-c8d7241f5560): created successfully Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7727e6d4-da06-4870-a265-6df835a9b4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Flow 'volume_create_manager' (924ee1d2-117b-4e38-b401-ccd4c5cbab6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e8c19acb-baff-41b9-b24c-b6363e776f61 tempest-TestStampPattern-1014361966 None] Created volume successfully. Sep 18 23:56:38 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe Sep 18 23:56:38 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-73cf8499-fe9f-409f-ae03-3d79f4c7e857 req-8f7bb525-b546-4c61-89d7-ff4d7744208f tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:38 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4fbf5f0-6493-4818-a937-a36a6f538932 tempest-VolumesExtendTest-920701055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe" returned: 0 in 0.583s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4fbf5f0-6493-4818-a937-a36a6f538932 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab 2G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4fbf5f0-6493-4818-a937-a36a6f538932 tempest-VolumesExtendTest-920701055 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab 2G" returned: 0 in 0.203s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c4fbf5f0-6493-4818-a937-a36a6f538932 tempest-VolumesExtendTest-920701055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.885s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-73cf8499-fe9f-409f-ae03-3d79f4c7e857 req-8f7bb525-b546-4c61-89d7-ff4d7744208f tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.485s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-73cf8499-fe9f-409f-ae03-3d79f4c7e857 req-8f7bb525-b546-4c61-89d7-ff4d7744208f tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c4fbf5f0-6493-4818-a937-a36a6f538932 tempest-VolumesExtendTest-920701055 None] Extend volume completed successfully. Sep 18 23:56:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-73cf8499-fe9f-409f-ae03-3d79f4c7e857 req-8f7bb525-b546-4c61-89d7-ff4d7744208f tempest-TestInstancesWithCinderVolumes-223214885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '875e6c81-d5a9-417e-b683-a43e69c341ea', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:56:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-73cf8499-fe9f-409f-ae03-3d79f4c7e857 req-8f7bb525-b546-4c61-89d7-ff4d7744208f tempest-TestInstancesWithCinderVolumes-223214885 None] attachment_update completed successfully. Sep 18 23:56:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Acquiring lock "cinder-8410a058-176a-4f6f-bcc7-beaeb13ca5ab-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Lock "cinder-8410a058-176a-4f6f-bcc7-beaeb13ca5ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Acquiring lock "cinder-quobyte-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Lock "cinder-quobyte-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Acquiring lock "cinder-quobyte-8410a058-176a-4f6f-bcc7-beaeb13ca5ab" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Lock "cinder-quobyte-8410a058-176a-4f6f-bcc7-beaeb13ca5ab" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Deleting offline snapshot 8410a058-176a-4f6f-bcc7-beaeb13ca5ab of volume 4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:56:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] snapshot_file for this snap is: volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:56:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2acc16-4d33-4bce-98f1-98f306a6101e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:40 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab Sep 18 23:56:40 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:40 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab" returned: 0 in 0.761s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:56:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aa7f1d-b2e7-4b11-b6e9-ff96da70dd79]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:41 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe Sep 18 23:56:41 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:41 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe" returned: 0 in 0.843s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:41 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab Sep 18 23:56:41 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:42 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab" returned: 0 in 0.693s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:42 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab Sep 18 23:56:42 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:42 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-0727034e-2cdd-467c-9ae1-30ffe7187b82 req-c3124098-9fd4-438c-86c7-ef005d4e4eb2 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-0727034e-2cdd-467c-9ae1-30ffe7187b82 req-c3124098-9fd4-438c-86c7-ef005d4e4eb2 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe.8410a058-176a-4f6f-bcc7-beaeb13ca5ab" returned: 0 in 0.341s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-0727034e-2cdd-467c-9ae1-30ffe7187b82 req-c3124098-9fd4-438c-86c7-ef005d4e4eb2 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Lock "cinder-quobyte-8410a058-176a-4f6f-bcc7-beaeb13ca5ab" released by "_delete_snapshot" :: held 2.889s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Lock "cinder-quobyte-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe" released by "delete_snapshot" :: held 2.941s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-0727034e-2cdd-467c-9ae1-30ffe7187b82 req-c3124098-9fd4-438c-86c7-ef005d4e4eb2 tempest-TestInstancesWithCinderVolumes-223214885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39b87d5d-abf9-4426-863d-c32302a384c8', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:56:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-0727034e-2cdd-467c-9ae1-30ffe7187b82 req-c3124098-9fd4-438c-86c7-ef005d4e4eb2 tempest-TestInstancesWithCinderVolumes-223214885 None] attachment_update completed successfully. Sep 18 23:56:43 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Created reservations ['5389fb26-6326-471f-a516-a14376459f2e', '939d47a0-148c-4da1-bf2a-7db51796cfa3', '86260d91-e28e-49a6-b463-6505af4580ec', '302a2026-300a-429b-b927-3ffafbd8d756'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:56:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Delete snapshot completed successfully. Sep 18 23:56:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9e1d8971-74d6-4a20-9322-010a61680d22 tempest-VolumesExtendTest-920701055 None] Lock "cinder-8410a058-176a-4f6f-bcc7-beaeb13ca5ab-delete_snapshot" released by "delete_snapshot" :: held 3.239s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Acquiring lock "cinder-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Lock "cinder-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Acquiring lock "cinder-quobyte-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Lock "cinder-quobyte-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe" acquired by "delete_volume" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:43 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6112effa-671f-4401-a404-3ddf14ec11f0]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:43 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe Sep 18 23:56:43 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:44 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe" returned: 0 in 0.489s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:44 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe Sep 18 23:56:44 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:44 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe" returned: 0 in 0.278s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Lock "cinder-quobyte-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe" released by "delete_volume" :: held 0.899s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Created reservations ['9e21a54a-7581-4f2e-9c6b-a474ee07f5f1', 'cbb6c155-342b-4a02-b26a-60fdbcb07870', 'a3056212-40e6-4a9a-824c-6f7cdbe4a283', '61d5695b-2aa9-4e92-91d9-d3d0e9489e2b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:44 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:56:44 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:44 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.334s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:56:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Deleted volume successfully. Sep 18 23:56:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b7bf7031-0039-44fc-bc81-b09c81306ee5 tempest-VolumesExtendTest-920701055 None] Lock "cinder-4448f9c5-4f8c-42eb-a31a-dfc8dcd388fe-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-78c86cb2-7c1a-4b02-add6-f17d3553ecad req-61c0b829-91c1-4f13-87ef-e17d00e6e2e1 tempest-TestInstancesWithCinderVolumes-223214885 None] Terminate volume connection completed successfully. Sep 18 23:56:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-78c86cb2-7c1a-4b02-add6-f17d3553ecad req-61c0b829-91c1-4f13-87ef-e17d00e6e2e1 tempest-TestInstancesWithCinderVolumes-223214885 None] Deleting attachment 875e6c81-d5a9-417e-b683-a43e69c341ea. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Flow 'volume_create_manager' (19a46fa3-39bd-4a9e-8007-ec446e1acccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794454be-a0f2-4fd6-825a-38e5a6dd6c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794454be-a0f2-4fd6-825a-38e5a6dd6c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1241471239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d407f401-4666-4325-80f8-fa7e9e79a63b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a8b90c6dc5f4d0e978cf1a9978e6941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:50Z,use_quota=True,user_id='6d957d6db85a4894b7741d5dcc8fc76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607d2247-0891-4b91-82e7-3417e370a442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607d2247-0891-4b91-82e7-3417e370a442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a04fe1-92e3-47be-b5e6-95c2c59a75a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a04fe1-92e3-47be-b5e6-95c2c59a75a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd407f401-4666-4325-80f8-fa7e9e79a63b', 'volume_name': 'volume-d407f401-4666-4325-80f8-fa7e9e79a63b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404c76a1-d0ca-40d4-88de-22841349e8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404c76a1-d0ca-40d4-88de-22841349e8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ee5497-881f-4438-9fd3-4a3ad3abd124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:50 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Volume d407f401-4666-4325-80f8-fa7e9e79a63b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d407f401-4666-4325-80f8-fa7e9e79a63b', 'volume_size': 1} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1241471239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d407f401-4666-4325-80f8-fa7e9e79a63b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a8b90c6dc5f4d0e978cf1a9978e6941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:50Z,use_quota=True,user_id='6d957d6db85a4894b7741d5dcc8fc76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Creating volume d407f401-4666-4325-80f8-fa7e9e79a63b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:56:50 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d407f401-4666-4325-80f8-fa7e9e79a63b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "cinder-945b1b28-91bb-4fbb-8ef2-1687b2325e5d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:50 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d407f401-4666-4325-80f8-fa7e9e79a63b 1073741824 Sep 18 23:56:50 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "cinder-945b1b28-91bb-4fbb-8ef2-1687b2325e5d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "cinder-quobyte-945b1b28-91bb-4fbb-8ef2-1687b2325e5d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "cinder-quobyte-945b1b28-91bb-4fbb-8ef2-1687b2325e5d" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ebd35a-5d6a-4006-a38e-43932f011b2f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:50 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d Sep 18 23:56:50 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:50 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d407f401-4666-4325-80f8-fa7e9e79a63b 1073741824" returned: 0 in 0.544s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:50 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d" returned: 0 in 0.446s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d407f401-4666-4325-80f8-fa7e9e79a63b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:50 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d Sep 18 23:56:50 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:51 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d407f401-4666-4325-80f8-fa7e9e79a63b Sep 18 23:56:51 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:51 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-945b1b28-91bb-4fbb-8ef2-1687b2325e5d" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:51 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "cinder-quobyte-945b1b28-91bb-4fbb-8ef2-1687b2325e5d" released by "delete_volume" :: held 0.828s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d407f401-4666-4325-80f8-fa7e9e79a63b" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ee5497-881f-4438-9fd3-4a3ad3abd124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d407f401-4666-4325-80f8-fa7e9e79a63b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654b4c4c-91c1-4df2-9d43-30e127f17905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:51 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Volume volume-d407f401-4666-4325-80f8-fa7e9e79a63b (d407f401-4666-4325-80f8-fa7e9e79a63b): created successfully Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654b4c4c-91c1-4df2-9d43-30e127f17905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Flow 'volume_create_manager' (19a46fa3-39bd-4a9e-8007-ec446e1acccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:51 devstack cinder-volume[85963]: WARNING cinder.quota [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-977255413-1868425382 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-977255413-1868425382, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:56:51 devstack cinder-volume[85963]: WARNING cinder.quota [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-977255413-1868425382 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-977255413-1868425382, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:56:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-818676ca-5649-427c-9cd8-15713b1c3a64 tempest-VolumesListTestJSON-2052238910 None] Created volume successfully. Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Created reservations ['f156c2df-1c45-40b1-a2f6-332b3caef24c', 'ddd556eb-8462-49a6-87fe-5743c8982814', '2e1ec84a-132d-4423-9c84-aad2b84dbbe2', '09c9b7fb-d996-4bef-8e92-dd68ad7aa080'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:51 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:56:51 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:51 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.268s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:56:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Deleted volume successfully. Sep 18 23:56:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-521c224a-6c12-428b-95eb-34252b290b04 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "cinder-945b1b28-91bb-4fbb-8ef2-1687b2325e5d-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:52 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:56:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Flow 'volume_create_manager' (54d3171d-9725-464e-a8d0-763d2f17653d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0c1832-1f6d-48e0-9adf-e62e78b3264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0c1832-1f6d-48e0-9adf-e62e78b3264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1912133676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574324cf-7ff6-4cee-a250-a84628f48496,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a8b90c6dc5f4d0e978cf1a9978e6941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:53Z,use_quota=True,user_id='6d957d6db85a4894b7741d5dcc8fc76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5614cae4-4352-4761-8295-3153b0962c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5614cae4-4352-4761-8295-3153b0962c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86353632-b538-4afb-aa5e-de865bba44f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86353632-b538-4afb-aa5e-de865bba44f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '574324cf-7ff6-4cee-a250-a84628f48496', 'volume_name': 'volume-574324cf-7ff6-4cee-a250-a84628f48496', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9522ca1-cb1f-4868-97f5-b9aa375e0923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9522ca1-cb1f-4868-97f5-b9aa375e0923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641b1b83-c1ad-4118-a853-bbf8593e8037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:53 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Volume 574324cf-7ff6-4cee-a250-a84628f48496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-574324cf-7ff6-4cee-a250-a84628f48496', 'volume_size': 1} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1912133676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574324cf-7ff6-4cee-a250-a84628f48496,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a8b90c6dc5f4d0e978cf1a9978e6941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:53Z,use_quota=True,user_id='6d957d6db85a4894b7741d5dcc8fc76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Creating volume 574324cf-7ff6-4cee-a250-a84628f48496 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:56:53 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-574324cf-7ff6-4cee-a250-a84628f48496 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:53 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-574324cf-7ff6-4cee-a250-a84628f48496 1073741824 Sep 18 23:56:53 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:53 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-574324cf-7ff6-4cee-a250-a84628f48496 1073741824" returned: 0 in 0.523s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-574324cf-7ff6-4cee-a250-a84628f48496 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:53 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-574324cf-7ff6-4cee-a250-a84628f48496 Sep 18 23:56:53 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:53 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-574324cf-7ff6-4cee-a250-a84628f48496" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641b1b83-c1ad-4118-a853-bbf8593e8037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-574324cf-7ff6-4cee-a250-a84628f48496', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a67ca31-306c-4712-a4e6-482d5ad648b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:53 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Volume volume-574324cf-7ff6-4cee-a250-a84628f48496 (574324cf-7ff6-4cee-a250-a84628f48496): created successfully Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a67ca31-306c-4712-a4e6-482d5ad648b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Flow 'volume_create_manager' (54d3171d-9725-464e-a8d0-763d2f17653d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b4646343-9bc7-4cda-b914-662813d03eda tempest-VolumesListTestJSON-2052238910 None] Created volume successfully. Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Flow 'volume_create_manager' (12514cad-8351-4927-86db-8c8e5f04a1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a4a34c-dc68-48d2-9635-f249534f25e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a4a34c-dc68-48d2-9635-f249534f25e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1078518642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413b996e-966d-44ed-996c-e58601fad886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29243d58419847af8b8069574db7dac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:54Z,use_quota=True,user_id='7ce7814ed6064e499204551d894da2e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade95300-31d3-4b72-b0d9-c096c48a43ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade95300-31d3-4b72-b0d9-c096c48a43ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92af4d0b-9b5b-4259-84bb-fd2a143c3bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92af4d0b-9b5b-4259-84bb-fd2a143c3bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '413b996e-966d-44ed-996c-e58601fad886', 'volume_name': 'volume-413b996e-966d-44ed-996c-e58601fad886', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d52a6e-fbed-4d84-a12e-63eb3a451964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d52a6e-fbed-4d84-a12e-63eb3a451964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84db0228-9307-4daf-b5f5-8149c29c736c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Volume 413b996e-966d-44ed-996c-e58601fad886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-413b996e-966d-44ed-996c-e58601fad886', 'volume_size': 1} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1078518642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413b996e-966d-44ed-996c-e58601fad886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29243d58419847af8b8069574db7dac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:54Z,use_quota=True,user_id='7ce7814ed6064e499204551d894da2e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Creating volume 413b996e-966d-44ed-996c-e58601fad886 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:56:54 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-413b996e-966d-44ed-996c-e58601fad886 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:54 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-9bbb7d10-f116-4752-ab62-0edeb19f77e1 req-990f59ed-fb4e-4ce7-b943-5042c7c6811c tempest-TestInstancesWithCinderVolumes-223214885 None] Terminate volume connection completed successfully. Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9bbb7d10-f116-4752-ab62-0edeb19f77e1 req-990f59ed-fb4e-4ce7-b943-5042c7c6811c tempest-TestInstancesWithCinderVolumes-223214885 None] Deleting attachment 39b87d5d-abf9-4426-863d-c32302a384c8. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:56:54 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-413b996e-966d-44ed-996c-e58601fad886 1073741824 Sep 18 23:56:54 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:54 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-413b996e-966d-44ed-996c-e58601fad886 1073741824" returned: 0 in 0.422s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-413b996e-966d-44ed-996c-e58601fad886 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:54 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-413b996e-966d-44ed-996c-e58601fad886 Sep 18 23:56:54 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:55 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-413b996e-966d-44ed-996c-e58601fad886" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84db0228-9307-4daf-b5f5-8149c29c736c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-413b996e-966d-44ed-996c-e58601fad886', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50bc046f-1a58-4cb6-9210-73b16a057f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "cinder-b8adbd50-2b7c-4a17-ac2a-423e9d90317d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Volume volume-413b996e-966d-44ed-996c-e58601fad886 (413b996e-966d-44ed-996c-e58601fad886): created successfully Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50bc046f-1a58-4cb6-9210-73b16a057f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Flow 'volume_create_manager' (12514cad-8351-4927-86db-8c8e5f04a1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "cinder-b8adbd50-2b7c-4a17-ac2a-423e9d90317d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a15f5f4a-8f79-43a3-b663-bf7cc970e960 tempest-VolumesTransfersV355Test-1618740174 None] Created volume successfully. Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "cinder-quobyte-b8adbd50-2b7c-4a17-ac2a-423e9d90317d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "cinder-quobyte-b8adbd50-2b7c-4a17-ac2a-423e9d90317d" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbb35e9-93ed-4b8f-abed-6c46627ca8e1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:55 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d Sep 18 23:56:55 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Flow 'volume_create_manager' (ef86a22a-036a-43e9-be8e-a2d72e014b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cc87b7-b2ba-4bc3-8946-304399ff1a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cc87b7-b2ba-4bc3-8946-304399ff1a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1325654323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4763e9-8521-4cdb-ad48-b0dbcd1168c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a8b90c6dc5f4d0e978cf1a9978e6941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:56Z,use_quota=True,user_id='6d957d6db85a4894b7741d5dcc8fc76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8f00ad-ff98-450d-bbb5-67c86e3cba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8f00ad-ff98-450d-bbb5-67c86e3cba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e2511c-ff85-4028-8724-68da3e965f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e2511c-ff85-4028-8724-68da3e965f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4763e9-8521-4cdb-ad48-b0dbcd1168c1', 'volume_name': 'volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f10aa8-2c5e-4b01-a689-6b6f8f505e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f10aa8-2c5e-4b01-a689-6b6f8f505e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb02d5ed-c52b-4b1a-bc6d-b0c2cab12fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Volume 3a4763e9-8521-4cdb-ad48-b0dbcd1168c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1', 'volume_size': 1} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1325654323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4763e9-8521-4cdb-ad48-b0dbcd1168c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a8b90c6dc5f4d0e978cf1a9978e6941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:56Z,use_quota=True,user_id='6d957d6db85a4894b7741d5dcc8fc76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Creating volume 3a4763e9-8521-4cdb-ad48-b0dbcd1168c1 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:56:55 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:55 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1 1073741824 Sep 18 23:56:55 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:55 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d" returned: 0 in 0.527s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:55 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d Sep 18 23:56:55 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:56 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b8adbd50-2b7c-4a17-ac2a-423e9d90317d" returned: 0 in 0.366s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "cinder-quobyte-b8adbd50-2b7c-4a17-ac2a-423e9d90317d" released by "delete_volume" :: held 0.970s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:56 devstack cinder-volume[85963]: WARNING cinder.quota [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-70354751-361911737 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-70354751-361911737, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:56:56 devstack cinder-volume[85963]: WARNING cinder.quota [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-70354751-361911737 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-70354751-361911737, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:56:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2d46fad2-daa0-4dc4-a8f8-9c7a2bc85e2d tempest-VolumesTransfersV355Test-1405834328 None] Transfer volume completed successfully. Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Created reservations ['9ed8f937-601b-483e-9083-cc217b72e478', '4dcb0487-3853-4a78-a6d6-e129bb7491e6', '22111dc4-f161-440d-a5a0-52b61931d921', '16716675-4e21-42e0-a68e-d87a93dc68cf'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:56:56 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1 1073741824" returned: 0 in 0.611s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:56 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1 Sep 18 23:56:56 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:56 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:56:56 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:56 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.357s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:56:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Deleted volume successfully. Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5425d48a-3f60-4e82-ae53-328d74c80892 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "cinder-b8adbd50-2b7c-4a17-ac2a-423e9d90317d-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:56 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1" returned: 0 in 0.467s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb02d5ed-c52b-4b1a-bc6d-b0c2cab12fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce734a0-3276-4042-8481-d0a40c033f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:56 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Volume volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1 (3a4763e9-8521-4cdb-ad48-b0dbcd1168c1): created successfully Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce734a0-3276-4042-8481-d0a40c033f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Flow 'volume_create_manager' (ef86a22a-036a-43e9-be8e-a2d72e014b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f6fff738-f2f3-49a2-88e2-49fc66a00715 tempest-VolumesListTestJSON-2052238910 None] Created volume successfully. Sep 18 23:56:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Acquiring lock "cinder-413b996e-966d-44ed-996c-e58601fad886-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Lock "cinder-413b996e-966d-44ed-996c-e58601fad886-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Acquiring lock "cinder-quobyte-413b996e-966d-44ed-996c-e58601fad886" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:56:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Lock "cinder-quobyte-413b996e-966d-44ed-996c-e58601fad886" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:56:57 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd51156-b9df-4a42-b2c5-6ff183ea4c37]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:56:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-413b996e-966d-44ed-996c-e58601fad886 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:57 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-413b996e-966d-44ed-996c-e58601fad886 Sep 18 23:56:57 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:57 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-413b996e-966d-44ed-996c-e58601fad886" returned: 0 in 0.433s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-413b996e-966d-44ed-996c-e58601fad886 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:57 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-413b996e-966d-44ed-996c-e58601fad886 Sep 18 23:56:57 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:58 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-413b996e-966d-44ed-996c-e58601fad886" returned: 0 in 0.296s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Lock "cinder-quobyte-413b996e-966d-44ed-996c-e58601fad886" released by "delete_volume" :: held 0.786s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:58 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Created reservations ['5f8cc246-7779-4200-8df4-e0986e5c8835', '909c8e8a-93ef-4197-bdbc-55c507266995', 'c4bc37c4-0abb-4430-a4d5-b17ae77f0339', '8f35fe67-4da9-401c-92db-5b9fe83376eb'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:56:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:58 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:56:58 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:56:58 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Sep 18 23:56:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.593s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:56:58 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:56:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Deleted volume successfully. Sep 18 23:56:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f7ed5a06-d666-4be1-a277-67233bba41fb tempest-VolumesTransfersV355Test-1049434210 None] Lock "cinder-413b996e-966d-44ed-996c-e58601fad886-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Flow 'volume_create_manager' (b962b2e5-3bc0-4242-b4e8-8e01c2160afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42ca0c1-2747-44e8-9182-ae6aae91c527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42ca0c1-2747-44e8-9182-ae6aae91c527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-118693332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf77e6a6-0365-4f28-bc8e-abfe68d818bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29243d58419847af8b8069574db7dac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:59Z,use_quota=True,user_id='7ce7814ed6064e499204551d894da2e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b65b85a-3875-47bf-84a7-f8b5efaf76c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b65b85a-3875-47bf-84a7-f8b5efaf76c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c2636e-c47e-4841-b089-649f2e866485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c2636e-c47e-4841-b089-649f2e866485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf77e6a6-0365-4f28-bc8e-abfe68d818bb', 'volume_name': 'volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba7527b-465f-4eeb-9c85-b196f12517d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba7527b-465f-4eeb-9c85-b196f12517d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191cf759-1e15-444b-ba9f-3a95163c4343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:56:59 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Volume cf77e6a6-0365-4f28-bc8e-abfe68d818bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb', 'volume_size': 1} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-118693332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf77e6a6-0365-4f28-bc8e-abfe68d818bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29243d58419847af8b8069574db7dac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:56:59Z,use_quota=True,user_id='7ce7814ed6064e499204551d894da2e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Creating volume cf77e6a6-0365-4f28-bc8e-abfe68d818bb {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:56:59 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:56:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:56:59 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb 1073741824 Sep 18 23:56:59 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-369f5ab3-3f3f-44b3-ac8e-ceb2d1f1036e req-aeb76be9-ae06-4e08-9c49-49ecef400d19 tempest-TestInstancesWithCinderVolumes-223214885 None] Terminate volume connection completed successfully. Sep 18 23:57:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-369f5ab3-3f3f-44b3-ac8e-ceb2d1f1036e req-aeb76be9-ae06-4e08-9c49-49ecef400d19 tempest-TestInstancesWithCinderVolumes-223214885 None] Deleting attachment e3a9c892-dfb4-4ae2-a87d-40a76f825337. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:57:00 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb 1073741824" returned: 0 in 0.915s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:00 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb Sep 18 23:57:00 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:01 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb" returned: 0 in 0.339s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191cf759-1e15-444b-ba9f-3a95163c4343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9d9de8-5944-40c1-baaa-7a8fc61e3b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:01 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Volume volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb (cf77e6a6-0365-4f28-bc8e-abfe68d818bb): created successfully Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9d9de8-5944-40c1-baaa-7a8fc61e3b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Flow 'volume_create_manager' (b962b2e5-3bc0-4242-b4e8-8e01c2160afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:57:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9ffa727c-d52f-432a-995e-61bb906c851a tempest-VolumesTransfersV355Test-1618740174 None] Created volume successfully. Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "cinder-6bdee686-257e-4473-aeea-695d6b6cda2e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "cinder-6bdee686-257e-4473-aeea-695d6b6cda2e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "cinder-quobyte-6bdee686-257e-4473-aeea-695d6b6cda2e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "cinder-quobyte-6bdee686-257e-4473-aeea-695d6b6cda2e" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "cinder-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae77413-c23c-428f-89ae-49ed2de75442]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Lock "cinder-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "cinder-quobyte-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:01 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e Sep 18 23:57:01 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Lock "cinder-quobyte-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e6e81a-598e-4ab1-8efe-9b73730922ae]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Acquiring lock "cinder-cf77e6a6-0365-4f28-bc8e-abfe68d818bb-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Lock "cinder-cf77e6a6-0365-4f28-bc8e-abfe68d818bb-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:02 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1 Sep 18 23:57:02 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Acquiring lock "cinder-quobyte-cf77e6a6-0365-4f28-bc8e-abfe68d818bb" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Lock "cinder-quobyte-cf77e6a6-0365-4f28-bc8e-abfe68d818bb" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[445f88b2-0eb5-47b5-b22f-97175e3dbc08]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:02 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e" returned: 0 in 0.482s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:02 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e Sep 18 23:57:02 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:02 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb Sep 18 23:57:02 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:02 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1" returned: 0 in 0.443s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:02 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1 Sep 18 23:57:02 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:02 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6bdee686-257e-4473-aeea-695d6b6cda2e" returned: 0 in 0.292s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "cinder-quobyte-6bdee686-257e-4473-aeea-695d6b6cda2e" released by "delete_volume" :: held 0.856s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:02 devstack cinder-volume[85963]: WARNING cinder.quota [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455671091-1106168659 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455671091-1106168659, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:57:02 devstack cinder-volume[85963]: WARNING cinder.quota [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455671091-1106168659 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1455671091-1106168659, it is now deprecated. Please use the default quota class for default quota. Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Created reservations ['e0f34d92-deed-4ff8-a41e-6063d053a421', '5c96e932-8a99-486d-b174-653564815356', '0993b69b-717f-44fa-b786-428fba86370f', 'e0d6406b-2b8c-47d6-8861-fa781ae29175'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:02 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb" returned: 0 in 0.472s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:02 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb Sep 18 23:57:02 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:02 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1" returned: 0 in 0.365s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:02 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:02 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Lock "cinder-quobyte-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1" released by "delete_volume" :: held 0.906s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Created reservations ['36a98e5a-1ab3-45e5-88fd-6490227152ce', '25878618-c8cb-453e-a379-808b2df43094', 'd38d184a-2962-4b60-877a-2ebca4f5fbd9', '4678d790-f7d9-4c3e-aabe-83c3edc9ef6d'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:03 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf77e6a6-0365-4f28-bc8e-abfe68d818bb" returned: 0 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Lock "cinder-quobyte-cf77e6a6-0365-4f28-bc8e-abfe68d818bb" released by "delete_volume" :: held 0.854s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:03 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.391s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:03 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Created reservations ['761e5d66-9436-4b1f-ac4b-10efc85466fb', 'bc76ae8a-a9d8-40e3-96a1-1ebaf7daf4ae', '15d3d687-63e4-48bc-a920-d1b3754e4c9f', 'aa592055-727f-4dcc-85d5-9405d6be1257'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:03 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Deleted volume successfully. Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64aebbc5-2cc1-4468-b19a-e0eb62e3a613 tempest-TestInstancesWithCinderVolumes-223214885 None] Lock "cinder-6bdee686-257e-4473-aeea-695d6b6cda2e-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:03 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:03 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:03 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Deleted volume successfully. Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c76e7c5c-576e-4b4d-b630-f36d8f195ba0 tempest-VolumesListTestJSON-2052238910 None] Lock "cinder-3a4763e9-8521-4cdb-ad48-b0dbcd1168c1-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:03 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.386s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Deleted volume successfully. Sep 18 23:57:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7438d367-05a8-4b20-b052-8601e4773ec5 tempest-VolumesTransfersV355Test-1049434210 None] Lock "cinder-cf77e6a6-0365-4f28-bc8e-abfe68d818bb-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "cinder-574324cf-7ff6-4cee-a250-a84628f48496-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Lock "cinder-574324cf-7ff6-4cee-a250-a84628f48496-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "cinder-quobyte-574324cf-7ff6-4cee-a250-a84628f48496" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Lock "cinder-quobyte-574324cf-7ff6-4cee-a250-a84628f48496" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f038477a-8675-41d5-a957-f27d596d8899]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-574324cf-7ff6-4cee-a250-a84628f48496 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-396f61a1-42e6-4dec-9933-b11f4519320d req-2fcb0c09-3431-4d6a-98a1-dfed792869a2 tempest-TestStampPattern-1014361966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-396f61a1-42e6-4dec-9933-b11f4519320d req-2fcb0c09-3431-4d6a-98a1-dfed792869a2 tempest-TestStampPattern-1014361966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-396f61a1-42e6-4dec-9933-b11f4519320d req-2fcb0c09-3431-4d6a-98a1-dfed792869a2 tempest-TestStampPattern-1014361966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-396f61a1-42e6-4dec-9933-b11f4519320d req-2fcb0c09-3431-4d6a-98a1-dfed792869a2 tempest-TestStampPattern-1014361966 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13cbcc50-5f16-434d-8a84-f6577e9a04dc', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:57:04 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-574324cf-7ff6-4cee-a250-a84628f48496 Sep 18 23:57:04 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-396f61a1-42e6-4dec-9933-b11f4519320d req-2fcb0c09-3431-4d6a-98a1-dfed792869a2 tempest-TestStampPattern-1014361966 None] attachment_update completed successfully. Sep 18 23:57:05 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-574324cf-7ff6-4cee-a250-a84628f48496" returned: 0 in 0.535s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-574324cf-7ff6-4cee-a250-a84628f48496 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:05 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-574324cf-7ff6-4cee-a250-a84628f48496 Sep 18 23:57:05 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:05 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-574324cf-7ff6-4cee-a250-a84628f48496" returned: 0 in 0.340s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Lock "cinder-quobyte-574324cf-7ff6-4cee-a250-a84628f48496" released by "delete_volume" :: held 0.933s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Created reservations ['6206bdf8-3b1c-48ab-af23-ffc6e0192227', '2b01b31c-d05d-4576-9da0-043c43175d6f', '2fd4febc-e22a-4974-a473-84ae9de1274a', 'f3b1cbf3-c63e-46c4-a1d1-d7ca3b888382'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:05 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:05 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:05 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.365s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Deleted volume successfully. Sep 18 23:57:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dd404e51-4269-494c-8ab6-3889b311e74d tempest-VolumesListTestJSON-2052238910 None] Lock "cinder-574324cf-7ff6-4cee-a250-a84628f48496-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "cinder-d407f401-4666-4325-80f8-fa7e9e79a63b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Lock "cinder-d407f401-4666-4325-80f8-fa7e9e79a63b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "cinder-quobyte-d407f401-4666-4325-80f8-fa7e9e79a63b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Lock "cinder-quobyte-d407f401-4666-4325-80f8-fa7e9e79a63b" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b829c20b-f756-421b-aae0-58354a606475]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d407f401-4666-4325-80f8-fa7e9e79a63b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:07 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d407f401-4666-4325-80f8-fa7e9e79a63b Sep 18 23:57:07 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:07 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d407f401-4666-4325-80f8-fa7e9e79a63b" returned: 0 in 0.457s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d407f401-4666-4325-80f8-fa7e9e79a63b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:07 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d407f401-4666-4325-80f8-fa7e9e79a63b Sep 18 23:57:07 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:07 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d407f401-4666-4325-80f8-fa7e9e79a63b" returned: 0 in 0.325s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Lock "cinder-quobyte-d407f401-4666-4325-80f8-fa7e9e79a63b" released by "delete_volume" :: held 0.864s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Created reservations ['7e7abe2d-4046-4717-bbee-fee425db06eb', 'b085a9db-4254-409e-9089-dd9da3b72d25', '4c3afd63-ae41-4bff-a5e4-08e30a763eb5', 'df28e8da-de09-4634-94e9-d8bd4f56cb8c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:07 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:07 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:08 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-2fb2b0ab-e348-4e38-96e9-53c197f021bd req-ef84157e-baf4-4711-8892-acd7c49b8174 tempest-TestStampPattern-1014361966 None] Terminate volume connection completed successfully. Sep 18 23:57:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-2fb2b0ab-e348-4e38-96e9-53c197f021bd req-ef84157e-baf4-4711-8892-acd7c49b8174 tempest-TestStampPattern-1014361966 None] Deleting attachment 13cbcc50-5f16-434d-8a84-f6577e9a04dc. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:57:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.453s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:08 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Deleted volume successfully. Sep 18 23:57:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-73de7348-1c9f-4f6c-b36c-af4ddaff531f tempest-VolumesListTestJSON-2052238910 None] Lock "cinder-d407f401-4666-4325-80f8-fa7e9e79a63b-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (5807e35e-0390-43f2-a121-39927ed3276e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e99405b-b428-4f1b-b80c-ca26689f12e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e99405b-b428-4f1b-b80c-ca26689f12e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1432059099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da04dde6-b1bf-4a4a-9b02-14a43e214aa1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:57:14Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe3f9ef-ed84-4a8b-9efd-cf218e64b85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe3f9ef-ed84-4a8b-9efd-cf218e64b85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479c0ff6-cb7f-47fa-840e-9c867ee957ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479c0ff6-cb7f-47fa-840e-9c867ee957ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da04dde6-b1bf-4a4a-9b02-14a43e214aa1', 'volume_name': 'volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e273e7-7bec-4e4b-8045-7afa79c533b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e273e7-7bec-4e4b-8045-7afa79c533b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e714b4-11b2-4720-b603-ac4863e5a43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:13 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Volume da04dde6-b1bf-4a4a-9b02-14a43e214aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1', 'volume_size': 1} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1432059099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da04dde6-b1bf-4a4a-9b02-14a43e214aa1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:57:14Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Creating volume da04dde6-b1bf-4a4a-9b02-14a43e214aa1 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:57:13 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:57:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:14 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1 1073741824 Sep 18 23:57:14 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:14 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1 1073741824" returned: 0 in 0.513s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:14 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1 Sep 18 23:57:14 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:14 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1" returned: 0 in 0.314s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:57:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e714b4-11b2-4720-b603-ac4863e5a43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f58d67-f802-41ce-9363-c89c559e5f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Volume volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1 (da04dde6-b1bf-4a4a-9b02-14a43e214aa1): created successfully Sep 18 23:57:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f58d67-f802-41ce-9363-c89c559e5f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (5807e35e-0390-43f2-a121-39927ed3276e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:57:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b261521e-fc10-4a92-966e-ceaff2178342 tempest-VolumesGetTest-2010212676 None] Created volume successfully. Sep 18 23:57:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Acquiring lock "cinder-bacee4ba-b21d-42c8-be0c-c8d7241f5560-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Lock "cinder-bacee4ba-b21d-42c8-be0c-c8d7241f5560-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Acquiring lock "cinder-quobyte-bacee4ba-b21d-42c8-be0c-c8d7241f5560" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Lock "cinder-quobyte-bacee4ba-b21d-42c8-be0c-c8d7241f5560" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d12bfc2-1995-4315-90f8-2783c18ba48d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:16 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560 Sep 18 23:57:16 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:17 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560" returned: 0 in 0.527s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:17 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560 Sep 18 23:57:17 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (9949c736-7755-4b05-a61d-96cb663c304a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dcf4a8-5491-4156-af11-deb7a88c36af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dcf4a8-5491-4156-af11-deb7a88c36af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:57:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-204719101',display_name='tempest-VolumesGetTest-Volume-1414009034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de19333d-1748-456c-bf08-f5db289af7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:57:17Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96981df-c289-4173-b6bf-30961cd047b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96981df-c289-4173-b6bf-30961cd047b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad0012b-ddc8-48ff-bc6f-4b130359a3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad0012b-ddc8-48ff-bc6f-4b130359a3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de19333d-1748-456c-bf08-f5db289af7f5', 'volume_name': 'volume-de19333d-1748-456c-bf08-f5db289af7f5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b1a0ef-272a-4f9a-97aa-4e959419577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b1a0ef-272a-4f9a-97aa-4e959419577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb3fce2-d8ec-4bd9-9e64-8290e667d403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:17 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Volume de19333d-1748-456c-bf08-f5db289af7f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de19333d-1748-456c-bf08-f5db289af7f5', 'volume_size': 1} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:57:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-204719101',display_name='tempest-VolumesGetTest-Volume-1414009034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de19333d-1748-456c-bf08-f5db289af7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:57:17Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Creating volume de19333d-1748-456c-bf08-f5db289af7f5 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:57:17 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-de19333d-1748-456c-bf08-f5db289af7f5 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:17 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-de19333d-1748-456c-bf08-f5db289af7f5 1073741824 Sep 18 23:57:17 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:17 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bacee4ba-b21d-42c8-be0c-c8d7241f5560" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Lock "cinder-quobyte-bacee4ba-b21d-42c8-be0c-c8d7241f5560" released by "delete_volume" :: held 0.963s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Created reservations ['aeec953a-0966-4193-b5fd-52a25e285ef9', '8a74557d-a2ac-4b35-bcb8-e537454e6e7f', 'fb00d0b5-93f8-4661-838e-3c77749fa96f', 'd8c20e4c-ebbc-417f-a5ec-f47d3133d0e8'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:17 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:17 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:18 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.460s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Deleted volume successfully. Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5ded0b04-330d-49c2-9f38-4008e073c117 tempest-TestStampPattern-1014361966 None] Lock "cinder-bacee4ba-b21d-42c8-be0c-c8d7241f5560-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Acquiring lock "cinder-381a6224-201e-40f2-9447-6153177f9c97-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Lock "cinder-381a6224-201e-40f2-9447-6153177f9c97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Acquiring lock "cinder-quobyte-5425c925-4202-4ff0-a7e0-4f2539cdaa39" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:18 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Lock "cinder-quobyte-5425c925-4202-4ff0-a7e0-4f2539cdaa39" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Acquiring lock "cinder-quobyte-381a6224-201e-40f2-9447-6153177f9c97" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-de19333d-1748-456c-bf08-f5db289af7f5 1073741824" returned: 0 in 0.873s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Lock "cinder-quobyte-381a6224-201e-40f2-9447-6153177f9c97" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Deleting offline snapshot 381a6224-201e-40f2-9447-6153177f9c97 of volume 5425c925-4202-4ff0-a7e0-4f2539cdaa39 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] snapshot_file for this snap is: volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e5b829-ed5e-4482-b16f-7927de061591]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-de19333d-1748-456c-bf08-f5db289af7f5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:18 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-de19333d-1748-456c-bf08-f5db289af7f5 Sep 18 23:57:18 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:18 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 Sep 18 23:57:18 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:18 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-de19333d-1748-456c-bf08-f5db289af7f5" returned: 0 in 0.383s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb3fce2-d8ec-4bd9-9e64-8290e667d403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de19333d-1748-456c-bf08-f5db289af7f5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d41afe-e0fc-4a68-847e-2e07cebcff7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:18 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Volume volume-de19333d-1748-456c-bf08-f5db289af7f5 (de19333d-1748-456c-bf08-f5db289af7f5): created successfully Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d41afe-e0fc-4a68-847e-2e07cebcff7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (9949c736-7755-4b05-a61d-96cb663c304a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:57:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1a4cd120-9b19-4599-a50d-42b650b69d1c tempest-VolumesGetTest-2010212676 None] Created volume successfully. Sep 18 23:57:18 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97" returned: 0 in 0.666s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:57:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cae176e-8af2-423b-9cf8-e0766e0018fe]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:19 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 Sep 18 23:57:19 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-de19333d-1748-456c-bf08-f5db289af7f5-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Lock "cinder-de19333d-1748-456c-bf08-f5db289af7f5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-quobyte-de19333d-1748-456c-bf08-f5db289af7f5" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-de19333d-1748-456c-bf08-f5db289af7f5" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[43072496-95b5-4679-8804-d126e17de82f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-de19333d-1748-456c-bf08-f5db289af7f5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:19 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39" returned: 0 in 0.692s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:19 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 Sep 18 23:57:19 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:19 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-de19333d-1748-456c-bf08-f5db289af7f5 Sep 18 23:57:19 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:20 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-de19333d-1748-456c-bf08-f5db289af7f5" returned: 0 in 0.498s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-de19333d-1748-456c-bf08-f5db289af7f5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:20 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-de19333d-1748-456c-bf08-f5db289af7f5 Sep 18 23:57:20 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:20 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97" returned: 0 in 0.592s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:20 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97 Sep 18 23:57:20 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:20 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-de19333d-1748-456c-bf08-f5db289af7f5" returned: 0 in 0.318s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-de19333d-1748-456c-bf08-f5db289af7f5" released by "delete_volume" :: held 0.889s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Created reservations ['9e24f172-8aa8-4d6c-ad7c-baf11d803871', '30937828-07e5-46ab-9d49-914895a3fd26', '977fe7d0-a3f1-4346-85e6-514ad69110bd', 'a6ba7910-8a75-4d65-b69a-02ee58808379'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:20 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39.381a6224-201e-40f2-9447-6153177f9c97" returned: 0 in 0.438s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:20 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:20 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Lock "cinder-quobyte-381a6224-201e-40f2-9447-6153177f9c97" released by "_delete_snapshot" :: held 2.588s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Lock "cinder-quobyte-5425c925-4202-4ff0-a7e0-4f2539cdaa39" released by "delete_snapshot" :: held 2.623s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Created reservations ['c28a0bc0-6ba8-47c7-b122-1398b70a6114', 'b1ef3633-f356-425e-a5ef-b5696ee564fa', '5829b4bb-17e1-4800-afe1-24cab10e85dc', 'f79ec333-af9c-4e65-97bf-39fa092d16ae'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Delete snapshot completed successfully. Sep 18 23:57:21 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30ff96e5-f385-4adb-a20f-6a7ffb023132 tempest-TestStampPattern-1014361966 None] Lock "cinder-381a6224-201e-40f2-9447-6153177f9c97-delete_snapshot" released by "delete_snapshot" :: held 2.941s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.362s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Deleted volume successfully. Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-460399d1-e9f8-47e5-9c80-fb828654b55e tempest-VolumesGetTest-2010212676 None] Lock "cinder-de19333d-1748-456c-bf08-f5db289af7f5-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:21 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:21 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:21 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 29 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-da04dde6-b1bf-4a4a-9b02-14a43e214aa1-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Lock "cinder-da04dde6-b1bf-4a4a-9b02-14a43e214aa1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-quobyte-da04dde6-b1bf-4a4a-9b02-14a43e214aa1" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-da04dde6-b1bf-4a4a-9b02-14a43e214aa1" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dcac5e-fe2f-4415-afec-2b24a3f1796c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:22 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1 Sep 18 23:57:22 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:22 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1" returned: 0 in 0.401s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:22 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1 Sep 18 23:57:22 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:22 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-da04dde6-b1bf-4a4a-9b02-14a43e214aa1" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-da04dde6-b1bf-4a4a-9b02-14a43e214aa1" released by "delete_volume" :: held 0.766s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Created reservations ['fb2bca39-1dd6-4bb2-b072-d2d4d636d66a', '47cf93dd-5d3c-4593-825a-d02573aad5ae', '2d60ea4e-a963-432e-b5d3-8014d1b280c3', 'd5458b83-2465-4455-a17b-2e339c3dbbc1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:22 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:22 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:23 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.404s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:23 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Deleted volume successfully. Sep 18 23:57:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea26dd62-84fb-4979-ae6e-b74db1d3b8c2 tempest-VolumesGetTest-2010212676 None] Lock "cinder-da04dde6-b1bf-4a4a-9b02-14a43e214aa1-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:23 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:57:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (66a2c42d-67be-405d-adf0-f73cfff78bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feadbe89-c25a-45ed-b2f4-073b13b61a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feadbe89-c25a-45ed-b2f4-073b13b61a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1008674534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53cb9fb-e415-4cf5-a207-be5fd1ac54bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:57:24Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b419cb0-2be1-4c9a-a08d-6c4f9fb0f4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b419cb0-2be1-4c9a-a08d-6c4f9fb0f4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986bcefe-fd58-407d-885c-bff860b66c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986bcefe-fd58-407d-885c-bff860b66c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd53cb9fb-e415-4cf5-a207-be5fd1ac54bd', 'volume_name': 'volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90f1e84-c814-48ee-b13b-748f83586ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90f1e84-c814-48ee-b13b-748f83586ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e041c7-ce2f-41ca-ab24-e709ae8626f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:24 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Volume d53cb9fb-e415-4cf5-a207-be5fd1ac54bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd', 'volume_size': 1} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1008674534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53cb9fb-e415-4cf5-a207-be5fd1ac54bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:57:24Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Creating volume d53cb9fb-e415-4cf5-a207-be5fd1ac54bd {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:57:24 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:24 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd 1073741824 Sep 18 23:57:24 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:24 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd 1073741824" returned: 0 in 0.783s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:25 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd Sep 18 23:57:25 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:25 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd" returned: 0 in 0.364s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:57:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e041c7-ce2f-41ca-ab24-e709ae8626f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a925f7-d370-4bf1-8e76-972ab4e04be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Volume volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd (d53cb9fb-e415-4cf5-a207-be5fd1ac54bd): created successfully Sep 18 23:57:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a925f7-d370-4bf1-8e76-972ab4e04be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (66a2c42d-67be-405d-adf0-f73cfff78bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:57:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e483c9d5-3017-48dd-9110-bb54a6f05c44 tempest-VolumesGetTest-2010212676 None] Created volume successfully. Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (599d689f-37ec-4fb8-aaa9-2107c1620f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5ea522-6380-4e11-8716-7faca1294682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5ea522-6380-4e11-8716-7faca1294682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1594135438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462be4dd-eeb2-4b6a-95b0-6d17d98d3a10,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d53cb9fb-e415-4cf5-a207-be5fd1ac54bd,status='creating',terminated_at=None,updated_at=2026-09-18T21:57:27Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911ca7f9-06cb-4e8e-a3a5-0156c7f4e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911ca7f9-06cb-4e8e-a3a5-0156c7f4e37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac896e1a-674a-47e3-afa0-fb24573a6c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac896e1a-674a-47e3-afa0-fb24573a6c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '462be4dd-eeb2-4b6a-95b0-6d17d98d3a10', 'volume_name': 'volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10', 'volume_size': 1, 'source_volid': 'd53cb9fb-e415-4cf5-a207-be5fd1ac54bd', 'source_volstatus': 'available'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712cc780-effc-4e76-bf49-6810d6b5628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712cc780-effc-4e76-bf49-6810d6b5628d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf565b1-bb31-4756-94b7-0f00aad0b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Volume 462be4dd-eeb2-4b6a-95b0-6d17d98d3a10: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10', 'volume_size': 1, 'source_volid': 'd53cb9fb-e415-4cf5-a207-be5fd1ac54bd', 'source_volstatus': 'available'} Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:26 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Cloning volume d53cb9fb-e415-4cf5-a207-be5fd1ac54bd to volume 462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 Sep 18 23:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Creating offline snapshot fdf8f1a8-dea7-4bbe-b590-0fac339740fb of volume d53cb9fb-e415-4cf5-a207-be5fd1ac54bd {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:57:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc05ed02-2bdf-41c8-857d-14c92316ddc7]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:27 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd Sep 18 23:57:27 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:27 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd" returned: 0 in 0.494s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:27 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb 1G Sep 18 23:57:27 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:28 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb 1G" returned: 0 in 0.527s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:28 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb Sep 18 23:57:28 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:28 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb" returned: 0 in 0.351s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:28 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb is being set with open permissions: ugo+rw Sep 18 23:57:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:28 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb Sep 18 23:57:28 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:28 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb" returned: 0 in 0.275s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:28 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.info Sep 18 23:57:28 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:29 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.info" returned: 0 in 0.316s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:29 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.info is being set with open permissions: ugo+rw Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:29 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.info Sep 18 23:57:29 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:29 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.info" returned: 0 in 0.270s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-quobyte-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] snapshot: fdf8f1a8-dea7-4bbe-b590-0fac339740fb, volume: 462be4dd-eeb2-4b6a-95b0-6d17d98d3a10, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2fd879-a88d-4ac8-89ab-efc5e4ba9bcd]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:29 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb Sep 18 23:57:29 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Acquiring lock "cinder-5425c925-4202-4ff0-a7e0-4f2539cdaa39-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Lock "cinder-5425c925-4202-4ff0-a7e0-4f2539cdaa39-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Acquiring lock "cinder-quobyte-5425c925-4202-4ff0-a7e0-4f2539cdaa39" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Lock "cinder-quobyte-5425c925-4202-4ff0-a7e0-4f2539cdaa39" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b25190-2a67-4754-a40f-9e62d2f8fe3f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:29 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb" returned: 0 in 0.514s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb19889-427c-4d65-9d4b-05e4091bf042]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:30 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 Sep 18 23:57:30 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:30 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd Sep 18 23:57:30 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:30 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39" returned: 0 in 0.482s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:30 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39 Sep 18 23:57:30 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:30 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd" returned: 0 in 0.560s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Path /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:30 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 Sep 18 23:57:30 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:30 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5425c925-4202-4ff0-a7e0-4f2539cdaa39" returned: 0 in 0.295s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Lock "cinder-quobyte-5425c925-4202-4ff0-a7e0-4f2539cdaa39" released by "delete_volume" :: held 0.879s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Created reservations ['efb3d8db-9bda-4119-a1a5-934445ed5b46', '847f21d4-83ac-4d35-a3e7-a06bf981df1e', '56fe92bf-d903-4d07-bcec-93dd0cd589a3', '0be2f79a-4c79-45ad-a21f-d1dc0ceefd36'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:30 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:30 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:31 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.352s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:31 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Deleted volume successfully. Sep 18 23:57:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-74ff85ca-124d-4eaf-b61f-3304aead199c tempest-TestStampPattern-1014361966 None] Lock "cinder-5425c925-4202-4ff0-a7e0-4f2539cdaa39-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:39 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10" returned: 0 in 8.932s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:39 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd, size 1024.00 MB, duration 8.93 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:57:39 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Converted 1024.00 MB image at 114.63 MB/s Sep 18 23:57:39 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 is being set with open permissions: ugo+rw Sep 18 23:57:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:39 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 Sep 18 23:57:39 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:39 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10" returned: 0 in 0.294s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10" released by "_copy_volume_from_snapshot" :: held 10.398s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:39 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=121,cinder:INSERT=35,cinder:UPDATE=162,cinder:DELETE=10 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:57:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-quobyte-fdf8f1a8-dea7-4bbe-b590-0fac339740fb" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-fdf8f1a8-dea7-4bbe-b590-0fac339740fb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Deleting offline snapshot fdf8f1a8-dea7-4bbe-b590-0fac339740fb of volume d53cb9fb-e415-4cf5-a207-be5fd1ac54bd {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:57:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] snapshot_file for this snap is: volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:57:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c86bb11-7fb9-44a8-a944-66a53c0d7f1b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:39 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb Sep 18 23:57:39 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:40 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb" returned: 0 in 0.419s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:57:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59cee8d-527e-4650-a7fb-39751361b969]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:40 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd Sep 18 23:57:40 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:40 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd" returned: 0 in 0.618s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:40 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb Sep 18 23:57:40 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:41 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=125,cinder:UPDATE=138,cinder:DELETE=12,cinder:INSERT=36 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:57:41 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb" returned: 0 in 0.540s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:41 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb Sep 18 23:57:41 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:41 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd.fdf8f1a8-dea7-4bbe-b590-0fac339740fb" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-fdf8f1a8-dea7-4bbe-b590-0fac339740fb" released by "_delete_snapshot" :: held 2.133s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.038s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf565b1-bb31-4756-94b7-0f00aad0b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10', 'volume_size': 1, 'source_volid': 'd53cb9fb-e415-4cf5-a207-be5fd1ac54bd', 'source_volstatus': 'available'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ceb70b3-c579-485f-bba8-fd06b9f81117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:42 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Volume volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 (462be4dd-eeb2-4b6a-95b0-6d17d98d3a10): created successfully Sep 18 23:57:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ceb70b3-c579-485f-bba8-fd06b9f81117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (599d689f-37ec-4fb8-aaa9-2107c1620f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:57:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-78335813-a029-426a-a8c2-df631aa929e7 tempest-VolumesGetTest-2010212676 None] Created volume successfully. Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (fba0306c-df84-4bc6-966a-a6f1c1ef7ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0341ef-6c1a-4585-85c8-cff04d7b88a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0341ef-6c1a-4585-85c8-cff04d7b88a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:57:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1716521061',display_name='tempest-VolumesGetTest-Volume-22380011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1fec3f-8b5a-4447-9d85-2fa1fee92b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:57:43Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efdbc65c-02b8-4604-a687-2e8ea86c69fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efdbc65c-02b8-4604-a687-2e8ea86c69fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1ff3b6-4c74-497e-8805-df807a580900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1ff3b6-4c74-497e-8805-df807a580900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c1fec3f-8b5a-4447-9d85-2fa1fee92b57', 'volume_name': 'volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa423483-6790-4074-8bce-8d96f5937d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa423483-6790-4074-8bce-8d96f5937d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d90c7f-e913-411e-9db5-f2e44819e59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Volume 3c1fec3f-8b5a-4447-9d85-2fa1fee92b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57', 'volume_size': 1} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:57:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1716521061',display_name='tempest-VolumesGetTest-Volume-22380011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1fec3f-8b5a-4447-9d85-2fa1fee92b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:57:43Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Creating volume 3c1fec3f-8b5a-4447-9d85-2fa1fee92b57 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:57:43 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:57:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:43 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57 1073741824 Sep 18 23:57:43 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:44 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57 1073741824" returned: 0 in 0.749s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:44 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57 Sep 18 23:57:44 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:44 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57" returned: 0 in 0.292s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:57:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d90c7f-e913-411e-9db5-f2e44819e59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2b2d6c-5aac-42a8-a05a-5e9c1e8e69f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:44 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Volume volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57 (3c1fec3f-8b5a-4447-9d85-2fa1fee92b57): created successfully Sep 18 23:57:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2b2d6c-5aac-42a8-a05a-5e9c1e8e69f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (fba0306c-df84-4bc6-966a-a6f1c1ef7ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:57:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-039cf93c-ef59-4aa1-8514-ab1f757780c0 tempest-VolumesGetTest-2010212676 None] Created volume successfully. Sep 18 23:57:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Lock "cinder-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-quobyte-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[52886b09-1fc1-4ae0-9091-af91f0488f9b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:45 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57 Sep 18 23:57:45 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:46 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57" returned: 0 in 0.640s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:46 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57 Sep 18 23:57:46 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:46 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57" returned: 0 in 0.335s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57" released by "delete_volume" :: held 1.077s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:46 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Created reservations ['e6fb275b-32e2-4f9f-adba-7307109d907d', '610e4d47-5bef-4592-9cb9-b3c822b5b11a', '2d8804ea-ec9a-4420-b1c4-b81390be9d1c', '67165cc0-a8e2-4fdc-95e4-808fa9e7c03a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:46 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:46 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:47 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.309s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:47 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Deleted volume successfully. Sep 18 23:57:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fe97fe46-8cee-4015-860e-dcfd2547e16b tempest-VolumesGetTest-2010212676 None] Lock "cinder-3c1fec3f-8b5a-4447-9d85-2fa1fee92b57-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Lock "cinder-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-quobyte-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:48 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b258ec-79a1-409e-861a-d7f6068111f0]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:48 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 Sep 18 23:57:48 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:48 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10" returned: 0 in 0.483s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:48 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10 Sep 18 23:57:48 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:48 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10" returned: 0 in 0.307s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10" released by "delete_volume" :: held 0.865s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Created reservations ['dc0ab3ce-1e7a-429b-8e70-45b9b46811c1', '47c3192c-7640-4c02-9914-d48305cd2025', '9826d638-0b44-43e5-9800-120fbe542be0', 'e92f5a9d-8821-44cf-bdeb-99d0b1bb4149'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:49 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:49 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Lock "cinder-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-quobyte-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[70501b19-4f77-4d28-b574-5b71248af257]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:49 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.382s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Deleted volume successfully. Sep 18 23:57:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1618e16c-7a81-4d3e-a065-f8b87032a29e tempest-VolumesGetTest-2010212676 None] Lock "cinder-462be4dd-eeb2-4b6a-95b0-6d17d98d3a10-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:49 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd Sep 18 23:57:49 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:50 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd" returned: 0 in 0.543s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:50 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd Sep 18 23:57:50 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:50 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd" returned: 0 in 0.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd" released by "delete_volume" :: held 1.062s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:50 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Created reservations ['ab1c18c1-c07c-444e-9173-c0f69c1318ba', '7363fe50-0bc0-4fb7-b240-360be806e3d0', 'b7564b4f-17d7-4e98-a928-64ef8f49e6fa', '91c85daf-735f-4d4d-878b-664656d4172b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:57:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:50 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:57:50 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:51 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.402s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:51 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:57:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Deleted volume successfully. Sep 18 23:57:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-29a36bae-4217-4ad1-8bb5-6a2785ad90f6 tempest-VolumesGetTest-2010212676 None] Lock "cinder-d53cb9fb-e415-4cf5-a207-be5fd1ac54bd-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:57:52 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:57:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (6104cdc8-b8de-4d4b-a577-540a36fe12e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:57:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e1f4d0-2263-467f-b8c7-08e9e59e5838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e1f4d0-2263-467f-b8c7-08e9e59e5838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-339344363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e498d2-cc61-493c-88a3-27092e5b2af7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:57:53Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57adaa4-a846-463b-ba5f-bbc2ce16c31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57adaa4-a846-463b-ba5f-bbc2ce16c31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25b6695-69cd-4cbd-896b-647a1168ee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:52 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 23:57:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25b6695-69cd-4cbd-896b-647a1168ee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9e498d2-cc61-493c-88a3-27092e5b2af7', 'volume_name': 'volume-d9e498d2-cc61-493c-88a3-27092e5b2af7', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d46877-ddbe-476f-b202-d1d112bd6459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d46877-ddbe-476f-b202-d1d112bd6459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:57:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247aafc1-f4d0-4204-b4b5-9fa5cd300805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:57:53 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Volume d9e498d2-cc61-493c-88a3-27092e5b2af7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9e498d2-cc61-493c-88a3-27092e5b2af7', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 23:57:53 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Trying to clone d9e498d2-cc61-493c-88a3-27092e5b2af7 from image 4b54cd3f-793e-47ca-910a-79fe5da0114d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 23:57:53 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 23:57:53 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Image download 20.69 MB at 20.69 MB/s Sep 18 23:57:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c1a364-88bd-47a7-9c49-8b9688165d1b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:54 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD Sep 18 23:57:54 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:54 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Temporary image 4b54cd3f-793e-47ca-910a-79fe5da0114d is fetched for user c79a4e57ff63406bb0b15349d8c87c72. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d357fea1-6673-4356-9400-d729552894e5]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:54 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD Sep 18 23:57:54 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:54 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-339344363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e498d2-cc61-493c-88a3-27092e5b2af7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:57:53Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Creating volume d9e498d2-cc61-493c-88a3-27092e5b2af7 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:57:54 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:57:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:54 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 1073741824 Sep 18 23:57:54 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:55 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 1073741824" returned: 0 in 0.601s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:55 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 Sep 18 23:57:55 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:55 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7" returned: 0 in 0.321s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:57:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:57:55 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Attempting download of 4b54cd3f-793e-47ca-910a-79fe5da0114d ((None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}])) to volume d9e498d2-cc61-493c-88a3-27092e5b2af7. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 23:57:55 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a0bed3-117c-43fb-a569-f56bd55eef40]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_425p20dl {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:56 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_425p20dl Sep 18 23:57:56 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:56 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_425p20dl" returned: 0 in 0.371s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_425p20dl {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:56 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_425p20dl Sep 18 23:57:56 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:56 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_425p20dl" returned: 1 in 0.340s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_425p20dl' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 23:57:56 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b59c833-ff76-4761-8474-337e2d63bfe0]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:57:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:56 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD Sep 18 23:57:56 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:57:57 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Sep 18 23:57:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:57:57 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] 4b54cd3f-793e-47ca-910a-79fe5da0114d was qcow2, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 23:57:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:57:57 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 Sep 18 23:57:57 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:00 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7" returned: 0 in 3.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_h23v6tvldevstack@QuobyteHD, size 112.00 MB, duration 3.26 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:58:00 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Converted 112.00 MB image at 34.34 MB/s Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:00 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 1G Sep 18 23:58:00 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Flow 'volume_create_manager' (b5ac4a2e-0900-4b2a-9364-2d46ad31c13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa2148f-4e0d-4cdd-b916-b6c0ed352551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa2148f-4e0d-4cdd-b916-b6c0ed352551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1503497764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48425696-9923-48d5-9397-ce9a940cf907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0684faa8e1e49cba6cfe32f90b68c56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:00Z,use_quota=True,user_id='6bc0e5d4fc4143749b8dbe17fb720bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d32c96c-a6a9-4da3-933d-98d4a8651bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d32c96c-a6a9-4da3-933d-98d4a8651bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eeb4196-5298-4648-a39e-51a7f4edba9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eeb4196-5298-4648-a39e-51a7f4edba9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48425696-9923-48d5-9397-ce9a940cf907', 'volume_name': 'volume-48425696-9923-48d5-9397-ce9a940cf907', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812f5c21-90b0-4df1-8a28-0b1943eedf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812f5c21-90b0-4df1-8a28-0b1943eedf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfea4256-ddc7-4352-98f0-22798da597c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Volume 48425696-9923-48d5-9397-ce9a940cf907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48425696-9923-48d5-9397-ce9a940cf907', 'volume_size': 1} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1503497764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48425696-9923-48d5-9397-ce9a940cf907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0684faa8e1e49cba6cfe32f90b68c56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:00Z,use_quota=True,user_id='6bc0e5d4fc4143749b8dbe17fb720bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Creating volume 48425696-9923-48d5-9397-ce9a940cf907 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:58:00 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:58:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48425696-9923-48d5-9397-ce9a940cf907 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:00 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48425696-9923-48d5-9397-ce9a940cf907 1073741824 Sep 18 23:58:00 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Flow 'volume_create_manager' (58806ca4-1994-4967-aa48-a85c33351920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e7dc03-c205-4667-ae8d-481d0da971d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e7dc03-c205-4667-ae8d-481d0da971d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-480810120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454860f2-cc56-4ff2-b4e5-7f6b4175e53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0684faa8e1e49cba6cfe32f90b68c56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:01Z,use_quota=True,user_id='6bc0e5d4fc4143749b8dbe17fb720bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:01 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7373ae-cdda-4306-b322-83c39ba2007d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7373ae-cdda-4306-b322-83c39ba2007d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3019ec-797b-482f-ad11-b8f087517ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3019ec-797b-482f-ad11-b8f087517ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '454860f2-cc56-4ff2-b4e5-7f6b4175e53e', 'volume_name': 'volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566e1e67-9147-4caf-a86f-2f51d5d7c99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566e1e67-9147-4caf-a86f-2f51d5d7c99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d149e4-da0a-4082-b4cc-3e3373e01f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:01 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Volume 454860f2-cc56-4ff2-b4e5-7f6b4175e53e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e', 'volume_size': 1} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 1G" returned: 0 in 1.076s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Downloaded image 4b54cd3f-793e-47ca-910a-79fe5da0114d ((None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}])) to volume d9e498d2-cc61-493c-88a3-27092e5b2af7 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Temporary image 4b54cd3f-793e-47ca-910a-79fe5da0114d for user c79a4e57ff63406bb0b15349d8c87c72 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Marking volume d9e498d2-cc61-493c-88a3-27092e5b2af7 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Copying metadata from image 4b54cd3f-793e-47ca-910a-79fe5da0114d to d9e498d2-cc61-493c-88a3-27092e5b2af7. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Creating volume glance metadata for volume d9e498d2-cc61-493c-88a3-27092e5b2af7 backed by image 4b54cd3f-793e-47ca-910a-79fe5da0114d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247aafc1-f4d0-4204-b4b5-9fa5cd300805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e498d2-cc61-493c-88a3-27092e5b2af7', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9200ab34-93d6-4008-b3f7-cffe4f52d18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Volume volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 (d9e498d2-cc61-493c-88a3-27092e5b2af7): created successfully Sep 18 23:58:02 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9200ab34-93d6-4008-b3f7-cffe4f52d18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (6104cdc8-b8de-4d4b-a577-540a36fe12e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48425696-9923-48d5-9397-ce9a940cf907 1073741824" returned: 0 in 1.203s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-64843537-3bc1-444f-bb62-7d1013d02e0f tempest-VolumesGetTest-2010212676 None] Created volume successfully. Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48425696-9923-48d5-9397-ce9a940cf907 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:02 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48425696-9923-48d5-9397-ce9a940cf907 Sep 18 23:58:02 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:02 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48425696-9923-48d5-9397-ce9a940cf907" returned: 0 in 0.477s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.332s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-480810120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454860f2-cc56-4ff2-b4e5-7f6b4175e53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0684faa8e1e49cba6cfe32f90b68c56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:01Z,use_quota=True,user_id='6bc0e5d4fc4143749b8dbe17fb720bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Creating volume 454860f2-cc56-4ff2-b4e5-7f6b4175e53e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:58:02 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:02 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e 1073741824 Sep 18 23:58:02 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfea4256-ddc7-4352-98f0-22798da597c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48425696-9923-48d5-9397-ce9a940cf907', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d333cf67-4322-4c17-9bf7-49d22fdcb990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Volume volume-48425696-9923-48d5-9397-ce9a940cf907 (48425696-9923-48d5-9397-ce9a940cf907): created successfully Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d333cf67-4322-4c17-9bf7-49d22fdcb990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Flow 'volume_create_manager' (b5ac4a2e-0900-4b2a-9364-2d46ad31c13c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9285ae4f-5a6a-47f3-a7b0-acc89477e07b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Created volume successfully. Sep 18 23:58:04 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e 1073741824" returned: 0 in 1.307s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:04 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e Sep 18 23:58:04 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (b42122cb-f16d-4d01-a6e0-590612c9024e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a171b5-2531-4d78-8516-a2b96df882a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a171b5-2531-4d78-8516-a2b96df882a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-283817892',display_name='tempest-VolumesGetTest-Volume-655094129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978c3123-35ea-4a23-8725-20a99939fa1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:04Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92000be-0081-467a-9c23-99c08eed8447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92000be-0081-467a-9c23-99c08eed8447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8c4574-5fae-4fde-80b5-5d83088c546a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8c4574-5fae-4fde-80b5-5d83088c546a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '978c3123-35ea-4a23-8725-20a99939fa1c', 'volume_name': 'volume-978c3123-35ea-4a23-8725-20a99939fa1c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bae62d-9cdb-4aac-b8aa-f8baf033536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bae62d-9cdb-4aac-b8aa-f8baf033536d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f79527-adab-4e73-999e-5d103f186cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:04 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Volume 978c3123-35ea-4a23-8725-20a99939fa1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-978c3123-35ea-4a23-8725-20a99939fa1c', 'volume_size': 1} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:04 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e" returned: 0 in 0.387s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.046s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-283817892',display_name='tempest-VolumesGetTest-Volume-655094129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978c3123-35ea-4a23-8725-20a99939fa1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f275baa9f44f8ba545031971a395bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:04Z,use_quota=True,user_id='c79a4e57ff63406bb0b15349d8c87c72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Creating volume 978c3123-35ea-4a23-8725-20a99939fa1c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:58:04 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-978c3123-35ea-4a23-8725-20a99939fa1c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:04 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-978c3123-35ea-4a23-8725-20a99939fa1c 1073741824 Sep 18 23:58:04 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d149e4-da0a-4082-b4cc-3e3373e01f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76897c01-b266-475a-96b3-4002d20b8f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:04 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Volume volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e (454860f2-cc56-4ff2-b4e5-7f6b4175e53e): created successfully Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76897c01-b266-475a-96b3-4002d20b8f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Flow 'volume_create_manager' (58806ca4-1994-4967-aa48-a85c33351920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-bb29f38e-d140-4233-8165-89efbf618544 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Created volume successfully. Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Flow 'volume_create_manager' (50e65bd3-6684-497f-923b-a44550489a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d1eb99-0069-4538-bc1b-c0410a0b2192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d1eb99-0069-4538-bc1b-c0410a0b2192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1253004247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71e9445-7c01-439d-9890-ad792c9d9239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10909d7d01ef4a028a4431d94ea09411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:05Z,use_quota=True,user_id='10a45e45ce5c47f08460101427f1a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:05 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdec2ec-5ae4-47aa-87b3-759ab6a41537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdec2ec-5ae4-47aa-87b3-759ab6a41537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffd3987-dab7-4c97-bbd9-fe52fbcbe0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffd3987-dab7-4c97-bbd9-fe52fbcbe0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e71e9445-7c01-439d-9890-ad792c9d9239', 'volume_name': 'volume-e71e9445-7c01-439d-9890-ad792c9d9239', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd58c5e6-660a-45c6-9ec9-4da5c24a1b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd58c5e6-660a-45c6-9ec9-4da5c24a1b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b650fd-8a24-491f-9da0-18d7c6253fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Volume e71e9445-7c01-439d-9890-ad792c9d9239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e71e9445-7c01-439d-9890-ad792c9d9239', 'volume_size': 1} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-978c3123-35ea-4a23-8725-20a99939fa1c 1073741824" returned: 0 in 0.827s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-978c3123-35ea-4a23-8725-20a99939fa1c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:05 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-978c3123-35ea-4a23-8725-20a99939fa1c Sep 18 23:58:05 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Flow 'volume_create_manager' (6e0b2e87-04de-4b0b-8da8-f242f8000f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70f58ef-613b-4edb-bdc3-e394984e628b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70f58ef-613b-4edb-bdc3-e394984e628b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2067201987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352c4192-abc9-455b-ab1f-5953a052b431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd00e723e60a47109a76d947a859489f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:06Z,use_quota=True,user_id='5b8673eac48b49038da2fcaffa2fae51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6c36b0-aee3-4053-8ff8-9a2766f35363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6c36b0-aee3-4053-8ff8-9a2766f35363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8b647b-a808-41b8-8027-814366696e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8b647b-a808-41b8-8027-814366696e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '352c4192-abc9-455b-ab1f-5953a052b431', 'volume_name': 'volume-352c4192-abc9-455b-ab1f-5953a052b431', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ef0c21-8e04-434a-b3ba-432863f6c563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ef0c21-8e04-434a-b3ba-432863f6c563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de56839-2ab7-4e41-bcf1-776e76b7f60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Volume 352c4192-abc9-455b-ab1f-5953a052b431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-352c4192-abc9-455b-ab1f-5953a052b431', 'volume_size': 1} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:05 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-978c3123-35ea-4a23-8725-20a99939fa1c" returned: 0 in 0.373s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1253004247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71e9445-7c01-439d-9890-ad792c9d9239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10909d7d01ef4a028a4431d94ea09411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:05Z,use_quota=True,user_id='10a45e45ce5c47f08460101427f1a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Creating volume e71e9445-7c01-439d-9890-ad792c9d9239 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:58:05 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f79527-adab-4e73-999e-5d103f186cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978c3123-35ea-4a23-8725-20a99939fa1c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f75a464-3004-4ea4-8760-8d49fd08d0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:05 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 1073741824 Sep 18 23:58:05 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Volume volume-978c3123-35ea-4a23-8725-20a99939fa1c (978c3123-35ea-4a23-8725-20a99939fa1c): created successfully Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f75a464-3004-4ea4-8760-8d49fd08d0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Flow 'volume_create_manager' (b42122cb-f16d-4d01-a6e0-590612c9024e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5c00314a-482a-4309-8d64-750a992b4af6 tempest-VolumesGetTest-2010212676 None] Created volume successfully. Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-978c3123-35ea-4a23-8725-20a99939fa1c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Lock "cinder-978c3123-35ea-4a23-8725-20a99939fa1c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:06 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 1073741824" returned: 0 in 0.661s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-quobyte-978c3123-35ea-4a23-8725-20a99939fa1c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-978c3123-35ea-4a23-8725-20a99939fa1c" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:06 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 Sep 18 23:58:06 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c58889-07aa-42a3-806f-54ba70ffb534]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-978c3123-35ea-4a23-8725-20a99939fa1c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:06 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-978c3123-35ea-4a23-8725-20a99939fa1c Sep 18 23:58:06 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:06 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239" returned: 0 in 0.322s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.144s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2067201987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352c4192-abc9-455b-ab1f-5953a052b431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd00e723e60a47109a76d947a859489f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:06Z,use_quota=True,user_id='5b8673eac48b49038da2fcaffa2fae51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Creating volume 352c4192-abc9-455b-ab1f-5953a052b431 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:58:06 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-352c4192-abc9-455b-ab1f-5953a052b431 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b650fd-8a24-491f-9da0-18d7c6253fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71e9445-7c01-439d-9890-ad792c9d9239', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:06 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-352c4192-abc9-455b-ab1f-5953a052b431 1073741824 Sep 18 23:58:06 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e227a668-138e-450b-959f-e33da4c6371c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:06 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Volume volume-e71e9445-7c01-439d-9890-ad792c9d9239 (e71e9445-7c01-439d-9890-ad792c9d9239): created successfully Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e227a668-138e-450b-959f-e33da4c6371c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Flow 'volume_create_manager' (50e65bd3-6684-497f-923b-a44550489a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f38b8ed3-b607-42d0-bc4c-089a125c71c4 tempest-VolumeDependencyTests-1359458457 None] Created volume successfully. Sep 18 23:58:07 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-978c3123-35ea-4a23-8725-20a99939fa1c" returned: 0 in 0.524s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-978c3123-35ea-4a23-8725-20a99939fa1c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:07 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-978c3123-35ea-4a23-8725-20a99939fa1c Sep 18 23:58:07 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:07 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-978c3123-35ea-4a23-8725-20a99939fa1c" returned: 0 in 0.536s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-978c3123-35ea-4a23-8725-20a99939fa1c" released by "delete_volume" :: held 1.128s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Created reservations ['f28ea7ea-5c91-4a0b-8d92-a6ee8b372c41', 'ad530033-a1a1-4b4a-b7e5-70a99205cbae', '02ed156c-d637-40f7-94a3-7bf570e4f738', 'b8a99902-9547-4fcd-8939-7c8367316ac2'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:58:07 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-352c4192-abc9-455b-ab1f-5953a052b431 1073741824" returned: 0 in 0.877s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-352c4192-abc9-455b-ab1f-5953a052b431 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:07 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-352c4192-abc9-455b-ab1f-5953a052b431 Sep 18 23:58:07 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:07 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:58:07 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:08 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-352c4192-abc9-455b-ab1f-5953a052b431" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.480s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:08 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de56839-2ab7-4e41-bcf1-776e76b7f60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352c4192-abc9-455b-ab1f-5953a052b431', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d7aa09-89f6-4d1f-8109-3f9fc112c8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Deleted volume successfully. Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] Creating offline snapshot 884f89fa-de6a-47b0-abcb-5cfc446732bf of volume e71e9445-7c01-439d-9890-ad792c9d9239 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:58:08 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Volume volume-352c4192-abc9-455b-ab1f-5953a052b431 (352c4192-abc9-455b-ab1f-5953a052b431): created successfully Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d7aa09-89f6-4d1f-8109-3f9fc112c8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Flow 'volume_create_manager' (6e0b2e87-04de-4b0b-8da8-f242f8000f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb0f758-9556-4505-8db7-c40d093c560c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ec774fd4-819b-4b26-aabf-c080d1f6f9b3 tempest-TestMinimumBasicScenario-1632096523 None] Created volume successfully. Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d4dc77b8-4a51-42cf-99bb-378048ad28a9 tempest-VolumesGetTest-2010212676 None] Lock "cinder-978c3123-35ea-4a23-8725-20a99939fa1c-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:08 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 Sep 18 23:58:08 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:08 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239" returned: 0 in 0.526s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:08 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf 1G Sep 18 23:58:08 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-d9e498d2-cc61-493c-88a3-27092e5b2af7-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Lock "cinder-d9e498d2-cc61-493c-88a3-27092e5b2af7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Acquiring lock "cinder-quobyte-d9e498d2-cc61-493c-88a3-27092e5b2af7" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-d9e498d2-cc61-493c-88a3-27092e5b2af7" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0b61b0-8962-4a9b-bb0f-4b2c2f21a116]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:58:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:09 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 Sep 18 23:58:09 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:09 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf 1G" returned: 0 in 0.827s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71e9445-7c01-439d-9890-ad792c9d9239 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:09 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71e9445-7c01-439d-9890-ad792c9d9239 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf Sep 18 23:58:09 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:09 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7" returned: 0 in 0.748s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:09 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7 Sep 18 23:58:09 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:10 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71e9445-7c01-439d-9890-ad792c9d9239 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf" returned: 0 in 0.640s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:10 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf is being set with open permissions: ugo+rw Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:10 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf Sep 18 23:58:10 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:10 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d9e498d2-cc61-493c-88a3-27092e5b2af7" returned: 0 in 0.510s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Lock "cinder-quobyte-d9e498d2-cc61-493c-88a3-27092e5b2af7" released by "delete_volume" :: held 1.357s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-9da57da5-8465-43d1-99a3-b2d505bfba8a req-e2e15ef4-83c8-4f4f-a406-d8163c19c3d1 tempest-TestMinimumBasicScenario-1632096523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Created reservations ['e163a8cd-a6ef-435b-8272-96a2bf15bd87', 'c6730ad2-bb90-42ee-8ae4-976d0c92d1ae', '93d1756b-53f8-4e0b-8735-2387af9b4acf', 'a2a775d7-0420-46c4-b5e0-497f3dc173d1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:10 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:58:10 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:10 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf" returned: 0 in 0.687s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:11 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.info Sep 18 23:58:11 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:11 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.508s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:11 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:58:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Deleted volume successfully. Sep 18 23:58:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13253bf6-8ca8-4db1-80ee-a027bf60494a tempest-VolumesGetTest-2010212676 None] Lock "cinder-d9e498d2-cc61-493c-88a3-27092e5b2af7-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:11 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.info" returned: 0 in 0.507s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:11 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.info is being set with open permissions: ugo+rw Sep 18 23:58:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:11 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.info Sep 18 23:58:11 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:12 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.info" returned: 0 in 0.529s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.938s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-9da57da5-8465-43d1-99a3-b2d505bfba8a req-e2e15ef4-83c8-4f4f-a406-d8163c19c3d1 tempest-TestMinimumBasicScenario-1632096523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.534s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-9da57da5-8465-43d1-99a3-b2d505bfba8a req-e2e15ef4-83c8-4f4f-a406-d8163c19c3d1 tempest-TestMinimumBasicScenario-1632096523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3d6e8327-0650-480b-9f66-f279ba89a818 tempest-VolumeDependencyTests-1359458457 None] Create snapshot completed successfully Sep 18 23:58:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9da57da5-8465-43d1-99a3-b2d505bfba8a req-e2e15ef4-83c8-4f4f-a406-d8163c19c3d1 tempest-TestMinimumBasicScenario-1632096523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-352c4192-abc9-455b-ab1f-5953a052b431', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0e7dab7-30ca-4eb1-a05f-d8cbdb9ad0ad', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:58:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-9da57da5-8465-43d1-99a3-b2d505bfba8a req-e2e15ef4-83c8-4f4f-a406-d8163c19c3d1 tempest-TestMinimumBasicScenario-1632096523 None] attachment_update completed successfully. Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Flow 'volume_create_manager' (280b328d-9db1-4178-9f30-325cb21e93fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363b3ae8-4f11-4125-b5b0-d7ed0354cee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363b3ae8-4f11-4125-b5b0-d7ed0354cee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1539582130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfa2dea-b347-4162-9814-19679eefe862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10909d7d01ef4a028a4431d94ea09411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=884f89fa-de6a-47b0-abcb-5cfc446732bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:14Z,use_quota=True,user_id='10a45e45ce5c47f08460101427f1a49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee02db35-3193-423d-87de-4a073bc43b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee02db35-3193-423d-87de-4a073bc43b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d8d49c-f432-4b4a-9b02-6f6d4615f139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d8d49c-f432-4b4a-9b02-6f6d4615f139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'acfa2dea-b347-4162-9814-19679eefe862', 'volume_name': 'volume-acfa2dea-b347-4162-9814-19679eefe862', 'volume_size': 1, 'snapshot_id': '884f89fa-de6a-47b0-abcb-5cfc446732bf'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf79be2-7fb8-40b9-a1e9-fc3fa52e3a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf79be2-7fb8-40b9-a1e9-fc3fa52e3a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ce756b-45f8-4f99-bdea-c5f32cfb0878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Volume acfa2dea-b347-4162-9814-19679eefe862: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-acfa2dea-b347-4162-9814-19679eefe862', 'volume_size': 1, 'snapshot_id': '884f89fa-de6a-47b0-abcb-5cfc446732bf'} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "cinder-quobyte-884f89fa-de6a-47b0-abcb-5cfc446732bf-acfa2dea-b347-4162-9814-19679eefe862" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-quobyte-884f89fa-de6a-47b0-abcb-5cfc446732bf-acfa2dea-b347-4162-9814-19679eefe862" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Creating volume acfa2dea-b347-4162-9814-19679eefe862 from snapshot 884f89fa-de6a-47b0-abcb-5cfc446732bf {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "cinder-quobyte-acfa2dea-b347-4162-9814-19679eefe862" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-quobyte-acfa2dea-b347-4162-9814-19679eefe862" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] snapshot: 884f89fa-de6a-47b0-abcb-5cfc446732bf, volume: acfa2dea-b347-4162-9814-19679eefe862, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b560b40-adc4-4fe2-b683-4193a14a891e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:14 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf Sep 18 23:58:14 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:14 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf" returned: 0 in 0.669s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71e9445-7c01-439d-9890-ad792c9d9239(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:58:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18ced54-3a2e-423c-b156-1ad71842c2d1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:58:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:15 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 Sep 18 23:58:15 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:15 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239" returned: 0 in 0.876s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 23:58:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 23:58:15 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Path /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 23:58:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:15 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862 Sep 18 23:58:15 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:20 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:58:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Flow 'volume_create_manager' (fe193863-d6e2-4058-bd37-8eac44effa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56df0ec5-10dd-41a9-8c61-1113720a601f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56df0ec5-10dd-41a9-8c61-1113720a601f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-584698409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a234184-ec90-4c1e-bc29-d0dbcffee8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e6861aa1ab4bce907779c15a9f1c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:21Z,use_quota=True,user_id='d77eb5ade5d44aeab2370b417a585173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579cca4a-b9b6-4ddd-8066-72ed8e2adb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579cca4a-b9b6-4ddd-8066-72ed8e2adb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7622470-8118-4b3c-ba2c-81f6f6e433e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7622470-8118-4b3c-ba2c-81f6f6e433e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a234184-ec90-4c1e-bc29-d0dbcffee8ae', 'volume_name': 'volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6946ac8-c3fb-4d99-b0da-4fdf05d3eee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6946ac8-c3fb-4d99-b0da-4fdf05d3eee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9245d2-f494-4b69-9d5f-1a8218b21b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Volume 8a234184-ec90-4c1e-bc29-d0dbcffee8ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae', 'volume_size': 1} Sep 18 23:58:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:58:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:21 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:58:21 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:22 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.918s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:22 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:58:22 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:58:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 29 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:58:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:58:27 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862" returned: 0 in 11.739s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:27 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239, size 1024.00 MB, duration 11.74 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:58:27 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Converted 1024.00 MB image at 87.23 MB/s Sep 18 23:58:27 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862 is being set with open permissions: ugo+rw Sep 18 23:58:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:27 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862 Sep 18 23:58:27 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:28 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862" returned: 0 in 0.450s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-quobyte-acfa2dea-b347-4162-9814-19679eefe862" released by "_copy_volume_from_snapshot" :: held 13.911s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-quobyte-884f89fa-de6a-47b0-abcb-5cfc446732bf-acfa2dea-b347-4162-9814-19679eefe862" released by "_create_volume_from_snapshot" :: held 14.002s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.025s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.187s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-584698409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a234184-ec90-4c1e-bc29-d0dbcffee8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e6861aa1ab4bce907779c15a9f1c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:58:21Z,use_quota=True,user_id='d77eb5ade5d44aeab2370b417a585173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Creating volume 8a234184-ec90-4c1e-bc29-d0dbcffee8ae {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:58:28 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:28 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae 1073741824 Sep 18 23:58:28 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ce756b-45f8-4f99-bdea-c5f32cfb0878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acfa2dea-b347-4162-9814-19679eefe862', 'volume_size': 1, 'snapshot_id': '884f89fa-de6a-47b0-abcb-5cfc446732bf'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9042baa3-e03c-4839-b30a-760ebee4f9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Volume volume-acfa2dea-b347-4162-9814-19679eefe862 (acfa2dea-b347-4162-9814-19679eefe862): created successfully Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9042baa3-e03c-4839-b30a-760ebee4f9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Flow 'volume_create_manager' (280b328d-9db1-4178-9f30-325cb21e93fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f0a34c46-aa57-4cee-a462-15959fff080e tempest-VolumeDependencyTests-1359458457 None] Created volume successfully. Sep 18 23:58:28 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae 1073741824" returned: 0 in 0.663s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:28 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae Sep 18 23:58:28 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:29 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae" returned: 0 in 0.313s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "cinder-884f89fa-de6a-47b0-abcb-5cfc446732bf-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9245d2-f494-4b69-9d5f-1a8218b21b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42af35ea-ca33-4a72-8a95-7d6759d817ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-884f89fa-de6a-47b0-abcb-5cfc446732bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "cinder-quobyte-e71e9445-7c01-439d-9890-ad792c9d9239" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Volume volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae (8a234184-ec90-4c1e-bc29-d0dbcffee8ae): created successfully Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42af35ea-ca33-4a72-8a95-7d6759d817ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Flow 'volume_create_manager' (fe193863-d6e2-4058-bd37-8eac44effa7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-quobyte-e71e9445-7c01-439d-9890-ad792c9d9239" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "cinder-quobyte-884f89fa-de6a-47b0-abcb-5cfc446732bf" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-940e401f-31e3-4c92-a432-ae1036290a3d tempest-VolumesNegativeTest-948159652 None] Created volume successfully. Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-quobyte-884f89fa-de6a-47b0-abcb-5cfc446732bf" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Deleting offline snapshot 884f89fa-de6a-47b0-abcb-5cfc446732bf of volume e71e9445-7c01-439d-9890-ad792c9d9239 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] snapshot_file for this snap is: volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[120630f2-ab47-409c-b3fa-9c60635111b5]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:29 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf Sep 18 23:58:29 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:29 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf" returned: 0 in 0.506s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71e9445-7c01-439d-9890-ad792c9d9239(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beeddaa-34b3-4962-bfa8-291ab0a244f3]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:58:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:30 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 Sep 18 23:58:30 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:30 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239" returned: 0 in 0.846s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:30 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf Sep 18 23:58:30 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:31 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf" returned: 0 in 0.875s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:31 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf Sep 18 23:58:31 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:31 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239.884f89fa-de6a-47b0-abcb-5cfc446732bf" returned: 0 in 0.325s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-quobyte-884f89fa-de6a-47b0-abcb-5cfc446732bf" released by "_delete_snapshot" :: held 2.721s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-quobyte-e71e9445-7c01-439d-9890-ad792c9d9239" released by "delete_snapshot" :: held 2.767s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:32 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Created reservations ['8a8701b4-80f3-43f4-8809-e85410f518f8', '373ac4ba-36bb-45ce-bdcf-35de3fa19c6a', '97969ed5-f1b5-4d7d-b80e-fc2115d1e170', 'c5dbcc71-b0c7-4ae4-b295-64f3b3dd3484'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:58:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Delete snapshot completed successfully. Sep 18 23:58:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d7d7ce4d-772d-416c-9b7b-352d170798ef tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-884f89fa-de6a-47b0-abcb-5cfc446732bf-delete_snapshot" released by "delete_snapshot" :: held 3.026s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "cinder-e71e9445-7c01-439d-9890-ad792c9d9239-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-e71e9445-7c01-439d-9890-ad792c9d9239-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "cinder-quobyte-e71e9445-7c01-439d-9890-ad792c9d9239" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-quobyte-e71e9445-7c01-439d-9890-ad792c9d9239" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d3c97d-9dfd-42d0-8684-43918a0b5f47]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:58:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:32 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 Sep 18 23:58:32 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:33 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239" returned: 0 in 0.469s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:33 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239 Sep 18 23:58:33 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:33 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-e71e9445-7c01-439d-9890-ad792c9d9239" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-quobyte-e71e9445-7c01-439d-9890-ad792c9d9239" released by "delete_volume" :: held 0.842s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Created reservations ['a03d67c9-8f8f-4269-a679-931730e29024', '9f87ef5f-f436-4ae7-9047-c8eca0b99bd2', 'ea1cd4eb-630a-460b-87d9-83062632f59a', '6b040865-815f-4582-8003-9049c91bfc91'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:33 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:58:33 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "cinder-acfa2dea-b347-4162-9814-19679eefe862-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-acfa2dea-b347-4162-9814-19679eefe862-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "cinder-quobyte-acfa2dea-b347-4162-9814-19679eefe862" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-quobyte-acfa2dea-b347-4162-9814-19679eefe862" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ac0c9c-2d6b-4033-811f-4cd565d5f527]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:58:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:34 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:58:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Deleted volume successfully. Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-725dc387-3ff0-4d23-a5f0-dc90a7217ee3 tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-e71e9445-7c01-439d-9890-ad792c9d9239-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:34 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862 Sep 18 23:58:34 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:34 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862" returned: 0 in 0.459s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:34 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862 Sep 18 23:58:34 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:34 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-acfa2dea-b347-4162-9814-19679eefe862" returned: 0 in 0.266s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-quobyte-acfa2dea-b347-4162-9814-19679eefe862" released by "delete_volume" :: held 0.817s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Created reservations ['3ee43614-ed41-4a24-97c5-4f6bff9dd863', 'd22fc884-cf53-4c7f-b64b-525c84742b25', '8afcdba4-b0bb-46ce-9247-3b3ec6d6d2b0', 'd0bc22a6-3256-4f64-8928-df692b490379'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:34 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:58:34 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:35 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.271s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:35 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:58:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Deleted volume successfully. Sep 18 23:58:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f67b0855-9309-46e5-8b74-1df9ed8e9d89 tempest-VolumeDependencyTests-1359458457 None] Lock "cinder-acfa2dea-b347-4162-9814-19679eefe862-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:44 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=98,cinder:SELECT=80,cinder:INSERT=29,cinder:DELETE=8 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:58:45 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=95,cinder:SELECT=78,cinder:INSERT=27,cinder:DELETE=10 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:58:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-673f103f-5c39-4413-85a3-381be4a48bb3 req-b1c07bc6-2dc0-405f-9b19-dea17edc442e tempest-TestServerVolumeAttachmentScenario-1549681336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-673f103f-5c39-4413-85a3-381be4a48bb3 req-b1c07bc6-2dc0-405f-9b19-dea17edc442e tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-673f103f-5c39-4413-85a3-381be4a48bb3 req-b1c07bc6-2dc0-405f-9b19-dea17edc442e tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-673f103f-5c39-4413-85a3-381be4a48bb3 req-b1c07bc6-2dc0-405f-9b19-dea17edc442e tempest-TestServerVolumeAttachmentScenario-1549681336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-48425696-9923-48d5-9397-ce9a940cf907', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '894dcc90-429d-4217-b37b-06ef394bb4af', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:58:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-673f103f-5c39-4413-85a3-381be4a48bb3 req-b1c07bc6-2dc0-405f-9b19-dea17edc442e tempest-TestServerVolumeAttachmentScenario-1549681336 None] attachment_update completed successfully. Sep 18 23:58:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Acquiring lock "cinder-8a234184-ec90-4c1e-bc29-d0dbcffee8ae-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Lock "cinder-8a234184-ec90-4c1e-bc29-d0dbcffee8ae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Acquiring lock "cinder-quobyte-8a234184-ec90-4c1e-bc29-d0dbcffee8ae" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:58:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Lock "cinder-quobyte-8a234184-ec90-4c1e-bc29-d0dbcffee8ae" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:58:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4116a15-eec0-4fea-91ac-027d56a27f5b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:58:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:51 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae Sep 18 23:58:51 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:52 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae" returned: 0 in 0.885s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:52 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae Sep 18 23:58:52 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:52 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8a234184-ec90-4c1e-bc29-d0dbcffee8ae" returned: 0 in 0.360s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Lock "cinder-quobyte-8a234184-ec90-4c1e-bc29-d0dbcffee8ae" released by "delete_volume" :: held 1.359s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:52 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Created reservations ['668316a9-ab70-4438-85ea-1f3e52647e44', '859b3b9c-f05a-4c3f-ba79-64ad381b78ee', 'e438d4da-7eaf-49c5-9218-b7dd757540e1', 'f8d27faf-241b-4a3c-a87f-c2bb4c2be9e9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:58:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:58:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:58:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:58:52 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:58:52 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:58:53 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Sep 18 23:58:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.378s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:58:53 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:58:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Deleted volume successfully. Sep 18 23:58:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8fa53a95-1c45-4434-8489-9861a3154507 tempest-VolumesNegativeTest-948159652 None] Lock "cinder-8a234184-ec90-4c1e-bc29-d0dbcffee8ae-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:58:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c9148f52-2cb6-4c03-9e39-e6921f6c7968 req-053f8a3a-c07d-468d-85f7-4e8883a156e6 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:58:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c9148f52-2cb6-4c03-9e39-e6921f6c7968 req-053f8a3a-c07d-468d-85f7-4e8883a156e6 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:58:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c9148f52-2cb6-4c03-9e39-e6921f6c7968 req-053f8a3a-c07d-468d-85f7-4e8883a156e6 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:58:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-c9148f52-2cb6-4c03-9e39-e6921f6c7968 req-053f8a3a-c07d-468d-85f7-4e8883a156e6 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd78daef0-04cd-4968-9cd3-14bc8bb1086a', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 23:58:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-c9148f52-2cb6-4c03-9e39-e6921f6c7968 req-053f8a3a-c07d-468d-85f7-4e8883a156e6 tempest-TestServerVolumeAttachmentScenario-1549681336 None] attachment_update completed successfully. Sep 18 23:58:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-96605cd2-2a17-4d83-b285-c77406743723 req-33005acd-44a0-4252-98d3-e53a3680c407 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Terminate volume connection completed successfully. Sep 18 23:58:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-96605cd2-2a17-4d83-b285-c77406743723 req-33005acd-44a0-4252-98d3-e53a3680c407 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Deleting attachment d78daef0-04cd-4968-9cd3-14bc8bb1086a. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:58:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-9073a432-0cb1-491c-92d7-ac53cc513a94 req-168cb6af-8e43-43d9-95c2-b21a7cbbfde5 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Terminate volume connection completed successfully. Sep 18 23:58:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9073a432-0cb1-491c-92d7-ac53cc513a94 req-168cb6af-8e43-43d9-95c2-b21a7cbbfde5 tempest-TestServerVolumeAttachmentScenario-1549681336 None] Deleting attachment 894dcc90-429d-4217-b37b-06ef394bb4af. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Flow 'volume_create_manager' (f052c51e-2e3b-40f0-9e52-c52943987160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a216a06-66d5-4b78-81ba-eb83fd489c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a216a06-66d5-4b78-81ba-eb83fd489c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2091537462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f9b360d6db4ef599d8eaec2995b36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:59:08Z,use_quota=True,user_id='8909422e764d4d0b85aac4f356c1b72c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fdd6f0-d73b-4ecc-be9d-85d235c2cde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fdd6f0-d73b-4ecc-be9d-85d235c2cde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b6b26b-43cb-4b6e-9c09-d57b655bca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b6b26b-43cb-4b6e-9c09-d57b655bca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf', 'volume_name': 'volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da17fcdf-07e8-49e7-b82b-6a2a4a135a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da17fcdf-07e8-49e7-b82b-6a2a4a135a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4062ec-05a8-4a48-ad04-3df6b20ecf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:07 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Volume 5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf', 'volume_size': 1} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2091537462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f9b360d6db4ef599d8eaec2995b36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:59:08Z,use_quota=True,user_id='8909422e764d4d0b85aac4f356c1b72c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Creating volume 5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:59:07 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:59:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:07 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf 1073741824 Sep 18 23:59:07 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:08 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf 1073741824" returned: 0 in 0.695s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:08 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf Sep 18 23:59:08 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:08 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:59:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4062ec-05a8-4a48-ad04-3df6b20ecf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f35641-ffc0-4141-8197-5f025601cfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:08 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Volume volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf (5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf): created successfully Sep 18 23:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f35641-ffc0-4141-8197-5f025601cfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Flow 'volume_create_manager' (f052c51e-2e3b-40f0-9e52-c52943987160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fc319f5a-f49f-4743-af44-0f1a0c6dd673 tempest-VolumesSnapshotTestJSON-93715473 None] Created volume successfully. Sep 18 23:59:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Acquiring lock "cinder-454860f2-cc56-4ff2-b4e5-7f6b4175e53e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "cinder-454860f2-cc56-4ff2-b4e5-7f6b4175e53e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Acquiring lock "cinder-quobyte-454860f2-cc56-4ff2-b4e5-7f6b4175e53e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "cinder-quobyte-454860f2-cc56-4ff2-b4e5-7f6b4175e53e" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b33f9c3-d8ed-477b-9f35-df997d50f926]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:09 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e Sep 18 23:59:09 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:10 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e" returned: 0 in 0.540s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:10 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e Sep 18 23:59:10 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] Creating offline snapshot 879660f5-8c8d-48bd-9f5b-196712439243 of volume 5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8edc620-57c5-44af-9cad-87912b558286]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:10 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-454860f2-cc56-4ff2-b4e5-7f6b4175e53e" returned: 0 in 0.450s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "cinder-quobyte-454860f2-cc56-4ff2-b4e5-7f6b4175e53e" released by "delete_volume" :: held 1.072s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:10 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf Sep 18 23:59:10 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Created reservations ['b6d1b9c6-a575-47d2-b875-6dc82421680a', '35c6bb06-e8da-40b5-9398-b40fae479327', '94491dd5-b84d-456e-97ea-4200f66dd541', '733a0045-f333-4296-a282-0c353e483c00'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:10 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:59:10 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:11 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf" returned: 0 in 0.655s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:11 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.337s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:11 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:59:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Deleted volume successfully. Sep 18 23:59:11 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 1G Sep 18 23:59:11 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dae4924b-2360-4027-97f8-53fe39443c9b tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "cinder-454860f2-cc56-4ff2-b4e5-7f6b4175e53e-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Acquiring lock "cinder-48425696-9923-48d5-9397-ce9a940cf907-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:11 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 1G" returned: 0 in 0.625s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "cinder-48425696-9923-48d5-9397-ce9a940cf907-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:11 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 Sep 18 23:59:11 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Acquiring lock "cinder-quobyte-48425696-9923-48d5-9397-ce9a940cf907" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "cinder-quobyte-48425696-9923-48d5-9397-ce9a940cf907" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6d9f87-c5bc-42ac-bb80-19918defe39e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48425696-9923-48d5-9397-ce9a940cf907 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:12 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48425696-9923-48d5-9397-ce9a940cf907 Sep 18 23:59:12 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:12 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243" returned: 0 in 0.513s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:12 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 is being set with open permissions: ugo+rw Sep 18 23:59:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:12 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 Sep 18 23:59:12 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:12 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48425696-9923-48d5-9397-ce9a940cf907" returned: 0 in 0.530s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48425696-9923-48d5-9397-ce9a940cf907 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:12 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48425696-9923-48d5-9397-ce9a940cf907 Sep 18 23:59:12 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:12 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243" returned: 0 in 0.380s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:12 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.info Sep 18 23:59:12 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:12 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48425696-9923-48d5-9397-ce9a940cf907" returned: 0 in 0.319s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "cinder-quobyte-48425696-9923-48d5-9397-ce9a940cf907" released by "delete_volume" :: held 0.932s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Created reservations ['c9eba510-3d5b-451a-9c38-88b0eb53c058', '40520c7c-749d-419c-8caa-e6154bc28e15', 'b82b3e22-8736-4468-907d-c0882417bf43', '517024e1-7f52-4ff0-af9b-dd2c27332733'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:59:13 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.info" returned: 0 in 0.299s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:13 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.info is being set with open permissions: ugo+rw Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:13 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.info Sep 18 23:59:13 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:13 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:59:13 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:13 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.296s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:59:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Deleted volume successfully. Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-58540fd8-6c75-4bfd-8e52-7182adb970ec tempest-TestServerVolumeAttachmentScenario-1549681336 None] Lock "cinder-48425696-9923-48d5-9397-ce9a940cf907-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:13 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.info" returned: 0 in 0.437s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.064s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-63f2dee1-3183-494d-9ec2-372021446184 tempest-VolumesSnapshotTestJSON-93715473 None] Create snapshot completed successfully Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-879660f5-8c8d-48bd-9f5b-196712439243-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-879660f5-8c8d-48bd-9f5b-196712439243-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-879660f5-8c8d-48bd-9f5b-196712439243" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-879660f5-8c8d-48bd-9f5b-196712439243" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Deleting offline snapshot 879660f5-8c8d-48bd-9f5b-196712439243 of volume 5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] snapshot_file for this snap is: volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eafc4ef-7d41-4145-9ac2-5d417e9bdff1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:15 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 Sep 18 23:59:15 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-c3b34ccb-9cb2-4a5f-8686-1f3559dab704 req-119bc724-38bc-436a-9ef7-a0191bc27965 tempest-TestMinimumBasicScenario-1632096523 None] Terminate volume connection completed successfully. Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-c3b34ccb-9cb2-4a5f-8686-1f3559dab704 req-119bc724-38bc-436a-9ef7-a0191bc27965 tempest-TestMinimumBasicScenario-1632096523 None] Deleting attachment b0e7dab7-30ca-4eb1-a05f-d8cbdb9ad0ad. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 23:59:15 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243" returned: 0 in 0.522s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a976ee87-232b-4ab5-be29-16b7115eeffa]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:15 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf Sep 18 23:59:15 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:16 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf" returned: 0 in 0.518s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:16 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 Sep 18 23:59:16 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Acquiring lock "cinder-352c4192-abc9-455b-ab1f-5953a052b431-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Lock "cinder-352c4192-abc9-455b-ab1f-5953a052b431-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Acquiring lock "cinder-quobyte-352c4192-abc9-455b-ab1f-5953a052b431" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Lock "cinder-quobyte-352c4192-abc9-455b-ab1f-5953a052b431" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7316c0c-912e-4237-8e95-88097cf82790]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-352c4192-abc9-455b-ab1f-5953a052b431 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:16 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-352c4192-abc9-455b-ab1f-5953a052b431 Sep 18 23:59:16 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:16 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243" returned: 0 in 0.517s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:16 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243 Sep 18 23:59:16 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:17 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-352c4192-abc9-455b-ab1f-5953a052b431" returned: 0 in 0.488s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-352c4192-abc9-455b-ab1f-5953a052b431 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:17 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf.879660f5-8c8d-48bd-9f5b-196712439243" returned: 0 in 0.302s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:17 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-352c4192-abc9-455b-ab1f-5953a052b431 Sep 18 23:59:17 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-879660f5-8c8d-48bd-9f5b-196712439243" released by "_delete_snapshot" :: held 2.050s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf" released by "delete_snapshot" :: held 2.085s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Created reservations ['e79bfdc6-5a5d-4a36-b040-76bbcb36de2b', 'cb43cd09-cc6f-49e1-ad26-e530b16a8115', 'b351c29a-75a2-42aa-a3eb-96afbaedc37e', 'e5de10bc-add1-4668-b818-26c2400a4603'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:59:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Delete snapshot completed successfully. Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-474431d6-e823-4b3f-b990-675667775e6e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-879660f5-8c8d-48bd-9f5b-196712439243-delete_snapshot" released by "delete_snapshot" :: held 2.351s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:17 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-352c4192-abc9-455b-ab1f-5953a052b431" returned: 0 in 0.387s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Lock "cinder-quobyte-352c4192-abc9-455b-ab1f-5953a052b431" released by "delete_volume" :: held 0.934s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Created reservations ['134d2a6f-ff44-48cf-8ccd-df5e25ba1e9f', '4698e55f-008e-4984-a154-8ea062993cd5', '48520867-5cdf-4af9-bf37-36b954e38499', '045cf10e-d4d8-48ae-a5b0-9c0dbeb74d88'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:17 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:59:17 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:17 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.302s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:59:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Deleted volume successfully. Sep 18 23:59:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-bb6e25e9-80d2-4456-9bcf-7a0edea952cc tempest-TestMinimumBasicScenario-1632096523 None] Lock "cinder-352c4192-abc9-455b-ab1f-5953a052b431-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Flow 'volume_create_manager' (55922276-fa6a-40a5-9782-c7a6878c32af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8945f2e2-37d6-42fb-b861-7560e2b9e06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8945f2e2-37d6-42fb-b861-7560e2b9e06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1527836634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274d7998-5adb-438d-be0c-2f20c78227b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f9b360d6db4ef599d8eaec2995b36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:59:19Z,use_quota=True,user_id='8909422e764d4d0b85aac4f356c1b72c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a0251c-d1ab-440d-b18d-ceb33f783680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a0251c-d1ab-440d-b18d-ceb33f783680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f71f42f-9abc-49a4-a17d-47de28410347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f71f42f-9abc-49a4-a17d-47de28410347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '274d7998-5adb-438d-be0c-2f20c78227b8', 'volume_name': 'volume-274d7998-5adb-438d-be0c-2f20c78227b8', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315ef3ca-e27e-42de-a881-0e244a831f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315ef3ca-e27e-42de-a881-0e244a831f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361ce873-04c4-4074-a4a1-46d0b75bcdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:18 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Volume 274d7998-5adb-438d-be0c-2f20c78227b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-274d7998-5adb-438d-be0c-2f20c78227b8', 'volume_size': 1} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1527836634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274d7998-5adb-438d-be0c-2f20c78227b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f9b360d6db4ef599d8eaec2995b36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:59:19Z,use_quota=True,user_id='8909422e764d4d0b85aac4f356c1b72c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Creating volume 274d7998-5adb-438d-be0c-2f20c78227b8 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:59:19 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:59:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:19 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 1073741824 Sep 18 23:59:19 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:19 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 1073741824" returned: 0 in 0.716s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:19 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 Sep 18 23:59:19 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:20 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8" returned: 0 in 0.346s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:59:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361ce873-04c4-4074-a4a1-46d0b75bcdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274d7998-5adb-438d-be0c-2f20c78227b8', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b9411e-0e3a-4a1c-bf93-4fc81e90a24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Volume volume-274d7998-5adb-438d-be0c-2f20c78227b8 (274d7998-5adb-438d-be0c-2f20c78227b8): created successfully Sep 18 23:59:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b9411e-0e3a-4a1c-bf93-4fc81e90a24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Flow 'volume_create_manager' (55922276-fa6a-40a5-9782-c7a6878c32af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-341d3656-f22f-4ec9-a2e5-630864ad86b6 tempest-VolumesSnapshotTestJSON-93715473 None] Created volume successfully. Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] Creating offline snapshot f5303bbe-9f12-4ccf-acf9-87705ad30f59 of volume 274d7998-5adb-438d-be0c-2f20c78227b8 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:59:21 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:59:21 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f257fa-a509-4fda-98db-402b29952846]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:21 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 Sep 18 23:59:21 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:21 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.374s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 29 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 23:59:21 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8" returned: 0 in 0.545s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:21 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 1G Sep 18 23:59:21 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:22 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 1G" returned: 0 in 0.624s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-274d7998-5adb-438d-be0c-2f20c78227b8 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:22 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-274d7998-5adb-438d-be0c-2f20c78227b8 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 Sep 18 23:59:22 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:22 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-274d7998-5adb-438d-be0c-2f20c78227b8 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59" returned: 0 in 0.389s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:22 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 is being set with open permissions: ugo+rw Sep 18 23:59:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:22 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 Sep 18 23:59:22 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:23 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:23 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.info Sep 18 23:59:23 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:23 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.info" returned: 0 in 0.289s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:23 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.info is being set with open permissions: ugo+rw Sep 18 23:59:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:23 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.info Sep 18 23:59:23 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:23 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.info" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.778s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fb66f354-f5ca-49e1-b23b-84c7e063ef63 tempest-VolumesSnapshotTestJSON-93715473 None] Create snapshot completed successfully Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Flow 'volume_create_manager' (c7bbfe74-d0c3-4987-8bf9-2894d49a2bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b701b9d7-95ef-4f7d-a686-7b35660d4bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b701b9d7-95ef-4f7d-a686-7b35660d4bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2065796725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3e5d50-710d-4ba6-839d-da952556a60e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f9b360d6db4ef599d8eaec2995b36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:59:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f5303bbe-9f12-4ccf-acf9-87705ad30f59,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:59:25Z,use_quota=True,user_id='8909422e764d4d0b85aac4f356c1b72c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88bef4b1-b708-4e45-899c-b4277960eab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88bef4b1-b708-4e45-899c-b4277960eab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a08a348-14ab-48d4-8ccb-e6d5fd2eaff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a08a348-14ab-48d4-8ccb-e6d5fd2eaff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c3e5d50-710d-4ba6-839d-da952556a60e', 'volume_name': 'volume-8c3e5d50-710d-4ba6-839d-da952556a60e', 'volume_size': 2, 'snapshot_id': 'f5303bbe-9f12-4ccf-acf9-87705ad30f59'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af7b256-0b53-45b4-9edd-6e42cacd7010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af7b256-0b53-45b4-9edd-6e42cacd7010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb57108d-8964-42f6-a338-594fcaf21071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Volume 8c3e5d50-710d-4ba6-839d-da952556a60e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c3e5d50-710d-4ba6-839d-da952556a60e', 'volume_size': 2, 'snapshot_id': 'f5303bbe-9f12-4ccf-acf9-87705ad30f59'} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-f5303bbe-9f12-4ccf-acf9-87705ad30f59-8c3e5d50-710d-4ba6-839d-da952556a60e" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-f5303bbe-9f12-4ccf-acf9-87705ad30f59-8c3e5d50-710d-4ba6-839d-da952556a60e" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Creating volume 8c3e5d50-710d-4ba6-839d-da952556a60e from snapshot f5303bbe-9f12-4ccf-acf9-87705ad30f59 {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-8c3e5d50-710d-4ba6-839d-da952556a60e" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-8c3e5d50-710d-4ba6-839d-da952556a60e" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] snapshot: f5303bbe-9f12-4ccf-acf9-87705ad30f59, volume: 8c3e5d50-710d-4ba6-839d-da952556a60e, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e252c7d3-45e5-436a-81cc-018c0d7ecc91]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:25 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 Sep 18 23:59:25 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:25 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59" returned: 0 in 0.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-274d7998-5adb-438d-be0c-2f20c78227b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[855b8b57-9202-4c23-bff2-474dcf99e3f5]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:25 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 Sep 18 23:59:26 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:26 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8" returned: 0 in 0.526s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 23:59:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 23:59:26 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Path /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 23:59:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:26 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e Sep 18 23:59:26 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:28 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:59:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Flow 'volume_create_manager' (4f76df74-daf6-4720-a1d3-fdd3b3e143cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd61293-c51c-40cf-9755-ece058519c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd61293-c51c-40cf-9755-ece058519c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1294522330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4effda-c84f-4212-819c-4700f39da8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b86eee125e4d79a82d4bb180f0f1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:59:28Z,use_quota=True,user_id='4bcc564beb634d56bb6f1c2d05dd86bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a05ef1-be6f-44ae-bd48-9aa807a50611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a05ef1-be6f-44ae-bd48-9aa807a50611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765b903d-83f7-496a-ad7f-5eb745c2da79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765b903d-83f7-496a-ad7f-5eb745c2da79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c4effda-c84f-4212-819c-4700f39da8a5', 'volume_name': 'volume-0c4effda-c84f-4212-819c-4700f39da8a5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301fe9c2-5116-45ca-94f1-2273550c5e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301fe9c2-5116-45ca-94f1-2273550c5e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8de3e6f-864d-4b2d-8641-5a587464e3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Volume 0c4effda-c84f-4212-819c-4700f39da8a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c4effda-c84f-4212-819c-4700f39da8a5', 'volume_size': 1} Sep 18 23:59:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:34 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e" returned: 0 in 8.210s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8, size 1024.00 MB, duration 8.21 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:59:34 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Converted 1024.00 MB image at 124.71 MB/s Sep 18 23:59:34 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e is being set with open permissions: ugo+rw Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:34 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e Sep 18 23:59:34 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:34 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-8c3e5d50-710d-4ba6-839d-da952556a60e" released by "_copy_volume_from_snapshot" :: held 9.598s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-f5303bbe-9f12-4ccf-acf9-87705ad30f59-8c3e5d50-710d-4ba6-839d-da952556a60e" released by "_create_volume_from_snapshot" :: held 9.694s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.722s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.627s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1294522330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4effda-c84f-4212-819c-4700f39da8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b86eee125e4d79a82d4bb180f0f1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:59:28Z,use_quota=True,user_id='4bcc564beb634d56bb6f1c2d05dd86bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Creating volume 0c4effda-c84f-4212-819c-4700f39da8a5 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:59:34 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:59:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:34 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 1073741824 Sep 18 23:59:34 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb57108d-8964-42f6-a338-594fcaf21071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c3e5d50-710d-4ba6-839d-da952556a60e', 'volume_size': 2, 'snapshot_id': 'f5303bbe-9f12-4ccf-acf9-87705ad30f59'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9218a1-f60b-4ad7-ba6b-0c41fa1ad1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Volume volume-8c3e5d50-710d-4ba6-839d-da952556a60e (8c3e5d50-710d-4ba6-839d-da952556a60e): created successfully Sep 18 23:59:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9218a1-f60b-4ad7-ba6b-0c41fa1ad1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Flow 'volume_create_manager' (c7bbfe74-d0c3-4987-8bf9-2894d49a2bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-744439d6-75f7-4eb3-9876-8a21c720acf2 tempest-VolumesSnapshotTestJSON-93715473 None] Created volume successfully. Sep 18 23:59:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-8c3e5d50-710d-4ba6-839d-da952556a60e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-8c3e5d50-710d-4ba6-839d-da952556a60e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-8c3e5d50-710d-4ba6-839d-da952556a60e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-8c3e5d50-710d-4ba6-839d-da952556a60e" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:35 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[db059a2a-40b8-4c69-9d6e-260f4082eb90]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:35 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e Sep 18 23:59:35 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:35 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 1073741824" returned: 0 in 0.786s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:35 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 Sep 18 23:59:35 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:36 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e" returned: 0 in 0.510s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:36 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e Sep 18 23:59:36 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:36 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5" returned: 0 in 0.344s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8de3e6f-864d-4b2d-8641-5a587464e3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4effda-c84f-4212-819c-4700f39da8a5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5ea3e5-1886-4d3c-bff6-f7186feacda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Volume volume-0c4effda-c84f-4212-819c-4700f39da8a5 (0c4effda-c84f-4212-819c-4700f39da8a5): created successfully Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5ea3e5-1886-4d3c-bff6-f7186feacda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Flow 'volume_create_manager' (4f76df74-daf6-4720-a1d3-fdd3b3e143cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-34594ee5-4428-4ad2-914a-8a72f9994b6e tempest-SnapshotDependencyTests-1375813142 None] Created volume successfully. Sep 18 23:59:36 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c3e5d50-710d-4ba6-839d-da952556a60e" returned: 0 in 0.335s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-8c3e5d50-710d-4ba6-839d-da952556a60e" released by "delete_volume" :: held 0.899s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Created reservations ['2e2ce2f6-2e74-428b-a709-734d0d893074', '52d0bda2-a2b4-476f-8861-aed1a5f7293e', '3984f3c3-0cfa-47de-9a88-3e8cf26db520', 'fa84a2ad-489d-4f6c-87ce-4e5db24495a8'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:36 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:59:36 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-f5303bbe-9f12-4ccf-acf9-87705ad30f59-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-f5303bbe-9f12-4ccf-acf9-87705ad30f59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-274d7998-5adb-438d-be0c-2f20c78227b8" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-274d7998-5adb-438d-be0c-2f20c78227b8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-f5303bbe-9f12-4ccf-acf9-87705ad30f59" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-f5303bbe-9f12-4ccf-acf9-87705ad30f59" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Deleting offline snapshot f5303bbe-9f12-4ccf-acf9-87705ad30f59 of volume 274d7998-5adb-438d-be0c-2f20c78227b8 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] snapshot_file for this snap is: volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac76d52-2c23-4ca1-ac13-ab1710e3d71b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:36 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.295s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:59:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Deleted volume successfully. Sep 18 23:59:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a24f4e60-1ba3-404f-96cc-69ba6bbab459 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-8c3e5d50-710d-4ba6-839d-da952556a60e-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:37 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 Sep 18 23:59:37 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] Creating offline snapshot b8e7e71d-3182-4de6-96d8-7d33447f91ab of volume 0c4effda-c84f-4212-819c-4700f39da8a5 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:59:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c69abaf-23db-4269-a3e8-8bd46d2eee3c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:37 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59" returned: 0 in 0.574s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-274d7998-5adb-438d-be0c-2f20c78227b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:59:37 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 Sep 18 23:59:37 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2211ac2-dd93-4425-9906-5e0462b783cf]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:37 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 Sep 18 23:59:37 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:37 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5" returned: 0 in 0.490s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:37 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab 1G Sep 18 23:59:37 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:38 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8" returned: 0 in 0.728s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:38 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 Sep 18 23:59:38 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:38 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab 1G" returned: 0 in 0.533s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c4effda-c84f-4212-819c-4700f39da8a5 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:38 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c4effda-c84f-4212-819c-4700f39da8a5 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab Sep 18 23:59:38 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:38 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c4effda-c84f-4212-819c-4700f39da8a5 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:38 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab is being set with open permissions: ugo+rw Sep 18 23:59:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:38 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab Sep 18 23:59:38 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:38 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59" returned: 0 in 0.539s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:38 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59 Sep 18 23:59:38 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:39 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab" returned: 0 in 0.337s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:39 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8.f5303bbe-9f12-4ccf-acf9-87705ad30f59" returned: 0 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:39 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.info Sep 18 23:59:39 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-f5303bbe-9f12-4ccf-acf9-87705ad30f59" released by "_delete_snapshot" :: held 2.364s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-274d7998-5adb-438d-be0c-2f20c78227b8" released by "delete_snapshot" :: held 2.403s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:39 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Created reservations ['aa558cfb-8100-4ddb-8f83-fa831c631247', '50bf2faf-a4d0-457d-9941-f08914498f9f', '12a27ab2-2181-410c-8375-3545ed77efab', '8e77cad3-e4cc-4b51-82e6-0ef0836b736c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:59:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Delete snapshot completed successfully. Sep 18 23:59:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f96266d-bd08-44ed-b659-b46a9237f9db tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-f5303bbe-9f12-4ccf-acf9-87705ad30f59-delete_snapshot" released by "delete_snapshot" :: held 2.606s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:39 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.info" returned: 0 in 0.306s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:39 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.info is being set with open permissions: ugo+rw Sep 18 23:59:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:39 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.info Sep 18 23:59:39 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:39 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.info" returned: 0 in 0.253s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d04e74cd-eb2e-41db-8a44-a83f8ea912c6 tempest-SnapshotDependencyTests-1375813142 None] Create snapshot completed successfully Sep 18 23:59:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-274d7998-5adb-438d-be0c-2f20c78227b8-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-274d7998-5adb-438d-be0c-2f20c78227b8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-274d7998-5adb-438d-be0c-2f20c78227b8" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-274d7998-5adb-438d-be0c-2f20c78227b8" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb6ef90-280c-4655-a81c-4d53f4f725b3]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:40 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 Sep 18 23:59:40 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:40 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8" returned: 0 in 0.497s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:40 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8 Sep 18 23:59:40 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:41 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-274d7998-5adb-438d-be0c-2f20c78227b8" returned: 0 in 0.366s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-274d7998-5adb-438d-be0c-2f20c78227b8" released by "delete_volume" :: held 0.962s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Created reservations ['ddf53943-0cfb-41a1-bff1-c7811278c553', '77e1b149-bf84-4af9-9132-17e2d50772fe', '839dfe68-3500-4017-b6fd-b418938af071', '4fb1a8a2-f857-42dc-9dc1-d86b08c8bd33'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:41 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:59:41 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Flow 'volume_create_manager' (2ebec764-09c7-428b-aca2-44e3dbb58bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558ac0be-3b99-45db-a19e-95687286b06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558ac0be-3b99-45db-a19e-95687286b06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6eb0fd6-7f98-41b2-8246-d722f4c7c120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b86eee125e4d79a82d4bb180f0f1a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8e7e71d-3182-4de6-96d8-7d33447f91ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:59:41Z,use_quota=True,user_id='4bcc564beb634d56bb6f1c2d05dd86bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a98f7ec-7ef7-4f2c-81c8-7a1ff9a77915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a98f7ec-7ef7-4f2c-81c8-7a1ff9a77915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2b90f1-6d2d-44fb-8bb8-1a751b4af3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2b90f1-6d2d-44fb-8bb8-1a751b4af3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6eb0fd6-7f98-41b2-8246-d722f4c7c120', 'volume_name': 'volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120', 'volume_size': 1, 'snapshot_id': 'b8e7e71d-3182-4de6-96d8-7d33447f91ab'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66b7e78-49fd-4e70-95f8-1591d4163956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66b7e78-49fd-4e70-95f8-1591d4163956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f94efc-ad7d-4478-b623-876f3bb73395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:41 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Volume b6eb0fd6-7f98-41b2-8246-d722f4c7c120: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120', 'volume_size': 1, 'snapshot_id': 'b8e7e71d-3182-4de6-96d8-7d33447f91ab'} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "cinder-quobyte-b8e7e71d-3182-4de6-96d8-7d33447f91ab-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-quobyte-b8e7e71d-3182-4de6-96d8-7d33447f91ab-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Creating volume b6eb0fd6-7f98-41b2-8246-d722f4c7c120 from snapshot b8e7e71d-3182-4de6-96d8-7d33447f91ab {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "cinder-quobyte-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-quobyte-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] snapshot: b8e7e71d-3182-4de6-96d8-7d33447f91ab, volume: b6eb0fd6-7f98-41b2-8246-d722f4c7c120, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 23:59:41 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.315s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:59:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Deleted volume successfully. Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0b0f95-7354-4f2e-ae42-229ff548371a]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-928e8f08-1569-49bd-894e-1939a83fec44 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-274d7998-5adb-438d-be0c-2f20c78227b8-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:41 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab Sep 18 23:59:41 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:42 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab" returned: 0 in 0.419s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c4effda-c84f-4212-819c-4700f39da8a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:59:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[066b047a-c1ac-4d6c-a478-9620fc35679a]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:42 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 Sep 18 23:59:42 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:42 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5" returned: 0 in 0.555s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 23:59:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 23:59:42 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Path /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 23:59:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:42 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120 Sep 18 23:59:42 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:42 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:59:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Flow 'volume_create_manager' (ab100588-39c8-47e4-b70d-402185c484bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90934d32-632a-4f19-9306-0f0c2373caab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90934d32-632a-4f19-9306-0f0c2373caab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1409986613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0fdeef-1932-443c-abf9-731df7d3e03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f9b360d6db4ef599d8eaec2995b36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:59:43Z,use_quota=True,user_id='8909422e764d4d0b85aac4f356c1b72c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70397286-3bc7-4b81-8801-a184841323c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70397286-3bc7-4b81-8801-a184841323c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67bd2c0-579e-44a5-acd0-070d66699a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67bd2c0-579e-44a5-acd0-070d66699a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a0fdeef-1932-443c-abf9-731df7d3e03b', 'volume_name': 'volume-4a0fdeef-1932-443c-abf9-731df7d3e03b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765e7358-d93d-409c-9e92-05f678fbaa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765e7358-d93d-409c-9e92-05f678fbaa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7acfff-318f-402e-92df-283a60ff99ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Volume 4a0fdeef-1932-443c-abf9-731df7d3e03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a0fdeef-1932-443c-abf9-731df7d3e03b', 'volume_size': 1} Sep 18 23:59:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:51 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" returned: 0 in 9.079s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:51 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5, size 1024.00 MB, duration 9.08 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 23:59:51 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Converted 1024.00 MB image at 112.76 MB/s Sep 18 23:59:51 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120 is being set with open permissions: ugo+rw Sep 18 23:59:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:51 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120 Sep 18 23:59:51 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:52 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" returned: 0 in 0.365s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-quobyte-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" released by "_copy_volume_from_snapshot" :: held 10.544s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=87,cinder:UPDATE=76,cinder:INSERT=16,cinder:DELETE=5 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=87,cinder:UPDATE=86,cinder:INSERT=23,cinder:DELETE=8 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-quobyte-b8e7e71d-3182-4de6-96d8-7d33447f91ab-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" released by "_create_volume_from_snapshot" :: held 10.640s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.662s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.138s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1409986613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0fdeef-1932-443c-abf9-731df7d3e03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f9b360d6db4ef599d8eaec2995b36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:59:43Z,use_quota=True,user_id='8909422e764d4d0b85aac4f356c1b72c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Creating volume 4a0fdeef-1932-443c-abf9-731df7d3e03b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:59:52 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:52 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b 1073741824 Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f94efc-ad7d-4478-b623-876f3bb73395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120', 'volume_size': 1, 'snapshot_id': 'b8e7e71d-3182-4de6-96d8-7d33447f91ab'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:52 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447ae2f6-b2e7-413c-93c3-fdabc411ff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:52 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Volume volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120 (b6eb0fd6-7f98-41b2-8246-d722f4c7c120): created successfully Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447ae2f6-b2e7-413c-93c3-fdabc411ff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Flow 'volume_create_manager' (2ebec764-09c7-428b-aca2-44e3dbb58bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5c4bac8a-0af7-4b39-b418-e9f9700f0432 tempest-SnapshotDependencyTests-1375813142 None] Created volume successfully. Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "cinder-b8e7e71d-3182-4de6-96d8-7d33447f91ab-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-b8e7e71d-3182-4de6-96d8-7d33447f91ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "cinder-quobyte-0c4effda-c84f-4212-819c-4700f39da8a5" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-quobyte-0c4effda-c84f-4212-819c-4700f39da8a5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "cinder-quobyte-b8e7e71d-3182-4de6-96d8-7d33447f91ab" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-quobyte-b8e7e71d-3182-4de6-96d8-7d33447f91ab" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Deleting offline snapshot b8e7e71d-3182-4de6-96d8-7d33447f91ab of volume 0c4effda-c84f-4212-819c-4700f39da8a5 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] snapshot_file for this snap is: volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[765edff7-b3eb-4fee-9901-5c4589a810c8]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:52 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b 1073741824" returned: 0 in 0.574s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:52 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab Sep 18 23:59:52 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:52 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b Sep 18 23:59:52 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:53 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b" returned: 0 in 0.296s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7acfff-318f-402e-92df-283a60ff99ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a0fdeef-1932-443c-abf9-731df7d3e03b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3d408f-699f-4363-beb9-5d97087f50c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:53 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Volume volume-4a0fdeef-1932-443c-abf9-731df7d3e03b (4a0fdeef-1932-443c-abf9-731df7d3e03b): created successfully Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3d408f-699f-4363-beb9-5d97087f50c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Flow 'volume_create_manager' (ab100588-39c8-47e4-b70d-402185c484bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-171d2638-57e8-4830-8959-b7158dfceded tempest-VolumesSnapshotTestJSON-93715473 None] Created volume successfully. Sep 18 23:59:53 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab" returned: 0 in 0.521s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c4effda-c84f-4212-819c-4700f39da8a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[14abf39e-9e55-4923-bd34-06ad2211dfe0]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:53 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 Sep 18 23:59:53 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:53 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5" returned: 0 in 0.625s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:53 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab Sep 18 23:59:53 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:54 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab" returned: 0 in 0.500s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:54 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab Sep 18 23:59:54 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] Creating offline snapshot b86cf6b9-3838-4367-afb8-20cee0c7be87 of volume 4a0fdeef-1932-443c-abf9-731df7d3e03b {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 23:59:54 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5093da41-2cc8-44da-a993-3deb2aeb8ae4]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:54 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b Sep 18 23:59:54 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:54 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5.b8e7e71d-3182-4de6-96d8-7d33447f91ab" returned: 0 in 0.448s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-quobyte-b8e7e71d-3182-4de6-96d8-7d33447f91ab" released by "_delete_snapshot" :: held 2.250s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-quobyte-0c4effda-c84f-4212-819c-4700f39da8a5" released by "delete_snapshot" :: held 2.289s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:55 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Created reservations ['0114f270-a653-4c1e-a87a-c05ffeab2b4a', 'bfcb3c10-c32a-45c6-9990-766cfa9f7e40', 'ddecb3db-789d-4120-85e2-8502f831e177', 'e6ecbebf-9977-4e6b-9ba6-d958fac2f096'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:59:55 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b" returned: 0 in 0.530s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:55 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 1G Sep 18 23:59:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Delete snapshot completed successfully. Sep 18 23:59:55 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7d432848-d3cf-4051-9f29-3f512d406af4 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-b8e7e71d-3182-4de6-96d8-7d33447f91ab-delete_snapshot" released by "delete_snapshot" :: held 2.510s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:55 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 1G" returned: 0 in 0.553s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a0fdeef-1932-443c-abf9-731df7d3e03b -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:55 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a0fdeef-1932-443c-abf9-731df7d3e03b -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 Sep 18 23:59:55 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "cinder-0c4effda-c84f-4212-819c-4700f39da8a5-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-0c4effda-c84f-4212-819c-4700f39da8a5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:56 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a0fdeef-1932-443c-abf9-731df7d3e03b -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87" returned: 0 in 0.420s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:56 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 is being set with open permissions: ugo+rw Sep 18 23:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "cinder-quobyte-0c4effda-c84f-4212-819c-4700f39da8a5" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:56 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 Sep 18 23:59:56 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-quobyte-0c4effda-c84f-4212-819c-4700f39da8a5" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:56 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[80337988-4eba-4e0a-9a49-68885992cedc]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:56 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 Sep 18 23:59:56 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:56 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:56 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.info Sep 18 23:59:56 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:56 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5" returned: 0 in 0.555s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:56 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.info" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:56 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.info is being set with open permissions: ugo+rw Sep 18 23:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:56 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5 Sep 18 23:59:56 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:56 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.info Sep 18 23:59:56 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:57 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c4effda-c84f-4212-819c-4700f39da8a5" returned: 0 in 0.332s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:57 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.info" returned: 0 in 0.325s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.632s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-quobyte-0c4effda-c84f-4212-819c-4700f39da8a5" released by "delete_volume" :: held 1.039s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-98b61807-5c55-458a-9b94-fde025d2714b tempest-VolumesSnapshotTestJSON-93715473 None] Create snapshot completed successfully Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Created reservations ['f8d77e44-aa05-4f0c-b6d7-2b4a8055146a', '9d7a39f7-4595-4485-916b-2b6103bf421f', 'e14da9fc-4ea8-4bac-8593-1bf69da14eca', '6efd29f3-1b19-4692-ae1c-ef85a6a49032'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:57 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 18 23:59:57 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:57 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.314s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 23:59:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Deleted volume successfully. Sep 18 23:59:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8c8d816f-b6ef-4456-ac90-4c35fd9e5490 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-0c4effda-c84f-4212-819c-4700f39da8a5-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "cinder-b6eb0fd6-7f98-41b2-8246-d722f4c7c120-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Flow 'volume_create_manager' (34753242-9a1a-4c03-8d9c-cb4079506828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64260ef-27d9-4539-9d12-ff3bd17fb125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-b6eb0fd6-7f98-41b2-8246-d722f4c7c120-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64260ef-27d9-4539-9d12-ff3bd17fb125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T21:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-137711792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2586b808-c08c-4532-8c4f-4cbb0af4aa7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f9b360d6db4ef599d8eaec2995b36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T21:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b86cf6b9-3838-4367-afb8-20cee0c7be87,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T21:59:58Z,use_quota=True,user_id='8909422e764d4d0b85aac4f356c1b72c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e093e11-b97c-45b2-aaca-f883d5207ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e093e11-b97c-45b2-aaca-f883d5207ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277d1e29-a21e-4bcf-984b-f3ff4c56408c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277d1e29-a21e-4bcf-984b-f3ff4c56408c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2586b808-c08c-4532-8c4f-4cbb0af4aa7b', 'volume_name': 'volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b', 'volume_size': 1, 'snapshot_id': 'b86cf6b9-3838-4367-afb8-20cee0c7be87'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f49a90f-da59-40e8-9aec-98b048322c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f49a90f-da59-40e8-9aec-98b048322c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8ff8fc-f616-414a-a71a-e4426d4e2409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 23:59:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Volume 2586b808-c08c-4532-8c4f-4cbb0af4aa7b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b', 'volume_size': 1, 'snapshot_id': 'b86cf6b9-3838-4367-afb8-20cee0c7be87'} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-b86cf6b9-3838-4367-afb8-20cee0c7be87-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-b86cf6b9-3838-4367-afb8-20cee0c7be87-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Creating volume 2586b808-c08c-4532-8c4f-4cbb0af4aa7b from snapshot b86cf6b9-3838-4367-afb8-20cee0c7be87 {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "cinder-quobyte-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] snapshot: b86cf6b9-3838-4367-afb8-20cee0c7be87, volume: 2586b808-c08c-4532-8c4f-4cbb0af4aa7b, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-quobyte-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf3c880-c51c-4868-ba73-21a1fb7e73fd]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32af840-eab3-4a82-b3e1-e10125f5f2f0]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:58 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120 Sep 18 23:59:58 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:58 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 Sep 18 23:59:58 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:59 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" returned: 0 in 0.685s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:59 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120 Sep 18 23:59:59 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:59 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87" returned: 0 in 0.826s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a0fdeef-1932-443c-abf9-731df7d3e03b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 23:59:59 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c686803-921b-432f-8e51-6635a2df1b05]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 23:59:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 23:59:59 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Sep 18 23:59:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" returned: 0 in 0.314s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 23:59:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-quobyte-b6eb0fd6-7f98-41b2-8246-d722f4c7c120" released by "delete_volume" :: held 1.130s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 23:59:59 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b Sep 18 23:59:59 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 23:59:59 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Created reservations ['3956b94d-6d89-453b-869b-b240202216c8', '97481af8-ce3e-4603-9930-6cb5dda69ae4', '10111bbc-c032-4c16-8532-b18d1837f4c4', '59220a6b-e39e-491a-84cc-76f8db9a27fe'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:00 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:00:00 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:00 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b" returned: 0 in 0.579s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Path /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:00 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b Sep 19 00:00:00 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:00 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.401s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:00:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Deleted volume successfully. Sep 19 00:00:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3e5760f3-ca08-4760-b100-e01c78b71c39 tempest-SnapshotDependencyTests-1375813142 None] Lock "cinder-b6eb0fd6-7f98-41b2-8246-d722f4c7c120-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:08 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" returned: 0 in 8.789s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b, size 1024.00 MB, duration 8.79 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 19 00:00:09 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Converted 1024.00 MB image at 116.49 MB/s Sep 19 00:00:09 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b is being set with open permissions: ugo+rw Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:09 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b Sep 19 00:00:09 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:09 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" returned: 0 in 0.263s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" released by "_copy_volume_from_snapshot" :: held 10.644s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-b86cf6b9-3838-4367-afb8-20cee0c7be87-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" released by "_create_volume_from_snapshot" :: held 10.725s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.749s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8ff8fc-f616-414a-a71a-e4426d4e2409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b', 'volume_size': 1, 'snapshot_id': 'b86cf6b9-3838-4367-afb8-20cee0c7be87'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c888e5-6155-4477-8cc7-017b4d40d072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:09 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Volume volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b (2586b808-c08c-4532-8c4f-4cbb0af4aa7b): created successfully Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c888e5-6155-4477-8cc7-017b4d40d072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Flow 'volume_create_manager' (34753242-9a1a-4c03-8d9c-cb4079506828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:00:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b8e5f9b4-faf5-4f50-b4ec-e79ff3bc848e tempest-VolumesSnapshotTestJSON-93715473 None] Created volume successfully. Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-2586b808-c08c-4532-8c4f-4cbb0af4aa7b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-2586b808-c08c-4532-8c4f-4cbb0af4aa7b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a0e722-bc86-4ffc-bb10-271923d99430]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:09 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b Sep 19 00:00:09 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:10 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" returned: 0 in 0.509s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:10 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b Sep 19 00:00:10 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:10 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-2586b808-c08c-4532-8c4f-4cbb0af4aa7b" released by "delete_volume" :: held 0.910s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:10 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Created reservations ['d43d19e3-c1fc-4b40-9446-b04e365e88a3', '9c524b5a-7600-4fc7-8a72-2765daf008cb', 'bfd5e621-ac02-4ed5-9276-8d7aa2fef0c7', '9d8d9eba-d15c-4ed1-8f85-5908e71096a5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:00:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:00:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:00:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:10 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:00:10 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-b86cf6b9-3838-4367-afb8-20cee0c7be87-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-b86cf6b9-3838-4367-afb8-20cee0c7be87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-4a0fdeef-1932-443c-abf9-731df7d3e03b" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-4a0fdeef-1932-443c-abf9-731df7d3e03b" acquired by "delete_snapshot" :: waited 0.045s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-b86cf6b9-3838-4367-afb8-20cee0c7be87" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-b86cf6b9-3838-4367-afb8-20cee0c7be87" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Deleting offline snapshot b86cf6b9-3838-4367-afb8-20cee0c7be87 of volume 4a0fdeef-1932-443c-abf9-731df7d3e03b {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] snapshot_file for this snap is: volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[73115423-cdbc-4cc1-b3b1-c6ef03f5a70c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:11 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.402s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:00:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Deleted volume successfully. Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-68ff5e33-aeec-4628-a42c-e48804e54ee4 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-2586b808-c08c-4532-8c4f-4cbb0af4aa7b-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:11 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 Sep 19 00:00:11 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:11 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87" returned: 0 in 0.620s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a0fdeef-1932-443c-abf9-731df7d3e03b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ae695c-274f-49b7-885e-f92db47769ac]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:12 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b Sep 19 00:00:12 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:12 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b" returned: 0 in 0.630s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:12 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 Sep 19 00:00:12 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:12 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87" returned: 0 in 0.474s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:13 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87 Sep 19 00:00:13 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:13 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b.b86cf6b9-3838-4367-afb8-20cee0c7be87" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-b86cf6b9-3838-4367-afb8-20cee0c7be87" released by "_delete_snapshot" :: held 2.273s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-4a0fdeef-1932-443c-abf9-731df7d3e03b" released by "delete_snapshot" :: held 2.311s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:13 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Created reservations ['f49197a6-8d29-4384-a34b-188b66c27257', '2cca7af4-683a-437b-b13b-14108e8a4d11', '5bfa9db4-fe44-4709-916e-0429a258b772', 'd46a59f7-dcfa-4506-9a0d-0dd5ecd9ab91'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:00:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Delete snapshot completed successfully. Sep 19 00:00:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b542a80-3087-4423-90f6-958517683eed tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-b86cf6b9-3838-4367-afb8-20cee0c7be87-delete_snapshot" released by "delete_snapshot" :: held 2.494s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-4a0fdeef-1932-443c-abf9-731df7d3e03b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:00:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-4a0fdeef-1932-443c-abf9-731df7d3e03b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:00:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-4a0fdeef-1932-443c-abf9-731df7d3e03b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:00:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-4a0fdeef-1932-443c-abf9-731df7d3e03b" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:00:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82b4ea5-70ad-4b3e-8940-06afe21ba2aa]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:14 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b Sep 19 00:00:14 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:15 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b" returned: 0 in 0.471s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:15 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b Sep 19 00:00:15 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:15 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4a0fdeef-1932-443c-abf9-731df7d3e03b" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-4a0fdeef-1932-443c-abf9-731df7d3e03b" released by "delete_volume" :: held 0.874s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Created reservations ['ff7ce70b-0397-4147-a02d-2d9828fcb648', 'f177f70b-bf24-4f9b-9324-890d3aeb0d1b', '8c692723-a801-453c-9284-8c7f934b148e', '2564f3e2-afd1-42a9-871d-4d4d1a4b9dcd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:15 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:00:15 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "cinder-quobyte-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[03845df5-417a-4d0c-8352-6cb8b220a38c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:15 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:00:16 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Flow 'volume_create_manager' (e0e798b9-9979-4736-8a19-0a968d18b24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee5ecd9-edd0-4274-9500-2272136fa7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.393s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:00:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Deleted volume successfully. Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee5ecd9-edd0-4274-9500-2272136fa7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1774239994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26203521-cbc1-41ec-adf2-17b111dc1a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36c511f824a4e129200c4c0e377759a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:00:16Z,use_quota=True,user_id='243fe1bf4b414d3eb14a21ed2520167c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d4b8bb-7c91-4dd0-b8d6-deeca3a92792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d4b8bb-7c91-4dd0-b8d6-deeca3a92792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd05af2b-f957-44b0-8ebb-d98771e23e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 19 00:00:16 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf Sep 19 00:00:16 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c39a4fae-b836-4912-b0f7-f6b67e153c79 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-4a0fdeef-1932-443c-abf9-731df7d3e03b-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:16 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf" returned: 0 in 0.486s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:16 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf Sep 19 00:00:16 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd05af2b-f957-44b0-8ebb-d98771e23e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26203521-cbc1-41ec-adf2-17b111dc1a72', 'volume_name': 'volume-26203521-cbc1-41ec-adf2-17b111dc1a72', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0597e123-cec3-4f63-a3fd-c027057421f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0597e123-cec3-4f63-a3fd-c027057421f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11b0354-2349-4936-8add-23c736130758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:16 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Volume 26203521-cbc1-41ec-adf2-17b111dc1a72: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26203521-cbc1-41ec-adf2-17b111dc1a72', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Trying to clone 26203521-cbc1-41ec-adf2-17b111dc1a72 from image 4b54cd3f-793e-47ca-910a-79fe5da0114d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 19 00:00:16 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-quobyte-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf" released by "delete_volume" :: held 0.900s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Created reservations ['bcf4d88a-79f4-4fbb-a9d5-c8685150bb65', '1c1ece54-77fd-4944-9f61-aa99bb82fcba', '70e376c9-45d3-4c1e-bc73-28c41baa2d6c', '527663dc-b1e5-4f5d-b34b-e18abd33ba9c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:17 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:00:17 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 19 00:00:17 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Image download 20.69 MB at 20.69 MB/s Sep 19 00:00:17 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.438s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:00:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Deleted volume successfully. Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-04ebae97-1510-4e47-9735-eccd7060cae7 tempest-VolumesSnapshotTestJSON-93715473 None] Lock "cinder-5c4a1c53-f877-47e0-ad3a-a3aff3fedbbf-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[625af396-9997-49f9-82f2-3c7ce4aaa4cc]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:17 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD Sep 19 00:00:17 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:17 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Temporary image 4b54cd3f-793e-47ca-910a-79fe5da0114d is fetched for user 243fe1bf4b414d3eb14a21ed2520167c. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[55221144-bb63-43f3-ac89-01fbdd0e3911]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:18 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD Sep 19 00:00:18 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:18 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD" returned: 0 in 0.516s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1774239994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26203521-cbc1-41ec-adf2-17b111dc1a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36c511f824a4e129200c4c0e377759a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:00:16Z,use_quota=True,user_id='243fe1bf4b414d3eb14a21ed2520167c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:00:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Creating volume 26203521-cbc1-41ec-adf2-17b111dc1a72 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:00:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:00:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:00:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:00:18 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:00:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:18 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 1073741824 Sep 19 00:00:18 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:19 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 1073741824" returned: 0 in 0.522s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:19 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 Sep 19 00:00:19 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:19 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:00:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:19 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Attempting download of 4b54cd3f-793e-47ca-910a-79fe5da0114d ((None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}])) to volume 26203521-cbc1-41ec-adf2-17b111dc1a72. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 19 00:00:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff1be05-8786-431d-bb63-7976179389b4]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_lcen4gj5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:19 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_lcen4gj5 Sep 19 00:00:19 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:19 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_lcen4gj5" returned: 0 in 0.386s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_lcen4gj5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:19 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_lcen4gj5 Sep 19 00:00:19 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:20 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_lcen4gj5" returned: 1 in 0.413s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b54cd3f-793e-47ca-910a-79fe5da0114d_lcen4gj5' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:00:20 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[80817940-b8e4-45a0-b01b-35ed7f7233f2]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:20 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD Sep 19 00:00:20 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:20 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:20 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] 4b54cd3f-793e-47ca-910a-79fe5da0114d was qcow2, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 19 00:00:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:20 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 Sep 19 00:00:20 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 19 00:00:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:00:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:00:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:21 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:00:21 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:21 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.365s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:00:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 19 00:00:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 29 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 19 00:00:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 19 00:00:23 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72" returned: 0 in 2.412s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b54cd3f-793e-47ca-910a-79fe5da0114d_ixl3qur0devstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 19 00:00:23 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Converted 112.00 MB image at 46.40 MB/s Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:23 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 1G Sep 19 00:00:23 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:23 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 1G" returned: 0 in 0.371s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Downloaded image 4b54cd3f-793e-47ca-910a-79fe5da0114d ((None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}])) to volume 26203521-cbc1-41ec-adf2-17b111dc1a72 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Temporary image 4b54cd3f-793e-47ca-910a-79fe5da0114d for user 243fe1bf4b414d3eb14a21ed2520167c is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Marking volume 26203521-cbc1-41ec-adf2-17b111dc1a72 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Copying metadata from image 4b54cd3f-793e-47ca-910a-79fe5da0114d to 26203521-cbc1-41ec-adf2-17b111dc1a72. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Creating volume glance metadata for volume 26203521-cbc1-41ec-adf2-17b111dc1a72 backed by image 4b54cd3f-793e-47ca-910a-79fe5da0114d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11b0354-2349-4936-8add-23c736130758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26203521-cbc1-41ec-adf2-17b111dc1a72', 'volume_size': 1, 'image_id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b54cd3f-793e-47ca-910a-79fe5da0114d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f70ec28f066f451d8265908b71e0b825', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b54cd3f-793e-47ca-910a-79fe5da0114d', 'created_at': datetime.datetime(2026, 9, 18, 21, 39, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 21, 39, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b54cd3f-793e-47ca-910a-79fe5da0114d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21cfad74-4cae-4338-8baf-b904f981ac09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Volume volume-26203521-cbc1-41ec-adf2-17b111dc1a72 (26203521-cbc1-41ec-adf2-17b111dc1a72): created successfully Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21cfad74-4cae-4338-8baf-b904f981ac09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Flow 'volume_create_manager' (e0e798b9-9979-4736-8a19-0a968d18b24e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:00:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dfe5b2d3-8382-404c-80e0-6f87fbce60a5 tempest-TestShelveInstance-1954266482 None] Created volume successfully. Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Flow 'volume_create_manager' (493e26ab-a4a0-413a-9395-e0dbd1f7d400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e48cd3d-be93-4d77-a7a0-3a7cadbc6dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e48cd3d-be93-4d77-a7a0-3a7cadbc6dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2143972641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c4c246-6029-4e2b-ae93-f5a83a9b8557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6297d4034a4fba800e2eb7fa697146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:00:25Z,use_quota=True,user_id='fc131e9bb77e4ac98434acf7bdd2e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09b8fb8-6adf-43c2-9b29-368c5d0bcb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09b8fb8-6adf-43c2-9b29-368c5d0bcb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd267f4-bd97-4878-ba2c-dcba035fddeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd267f4-bd97-4878-ba2c-dcba035fddeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0c4c246-6029-4e2b-ae93-f5a83a9b8557', 'volume_name': 'volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd297e9-c166-4251-891b-886712914ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd297e9-c166-4251-891b-886712914ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b23a1e5-4361-4fd6-9b91-e04a9b8c8ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Volume f0c4c246-6029-4e2b-ae93-f5a83a9b8557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557', 'volume_size': 1} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2143972641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c4c246-6029-4e2b-ae93-f5a83a9b8557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6297d4034a4fba800e2eb7fa697146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:00:25Z,use_quota=True,user_id='fc131e9bb77e4ac98434acf7bdd2e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Creating volume f0c4c246-6029-4e2b-ae93-f5a83a9b8557 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:00:25 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:25 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 1073741824 Sep 19 00:00:25 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:25 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 1073741824" returned: 0 in 0.615s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:25 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 Sep 19 00:00:25 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:26 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557" returned: 0 in 0.363s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:00:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b23a1e5-4361-4fd6-9b91-e04a9b8c8ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89210c3-457f-46f7-af63-95a41f6d0ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Volume volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 (f0c4c246-6029-4e2b-ae93-f5a83a9b8557): created successfully Sep 19 00:00:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89210c3-457f-46f7-af63-95a41f6d0ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Flow 'volume_create_manager' (493e26ab-a4a0-413a-9395-e0dbd1f7d400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:00:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-eb446c57-e027-498c-962b-f967d42db927 tempest-TestImageHashVerification-1167687063 None] Created volume successfully. Sep 19 00:00:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d577e5c6-e348-4175-a7d0-eb8b71c63d8b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:28 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 Sep 19 00:00:28 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:28 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557" returned: 0 in 0.488s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b102e5a5-0477-4c49-95f9-f1729ad15818]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:29 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 Sep 19 00:00:29 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-8d20a492-5c65-4d96-9253-4e238612939f req-53696118-88ed-4e01-8c01-3934c61a5454 tempest-TestShelveInstance-1954266482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:29 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557" returned: 0 in 0.496s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 /opt/stack/data/cinder/conversion/f0c4c246-6029-4e2b-ae93-f5a83a9b8557.temp_image.ff728ead-de76-47a1-8a64-87b18f1960bfnyhuaffn.img {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:29 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 /opt/stack/data/cinder/conversion/f0c4c246-6029-4e2b-ae93-f5a83a9b8557.temp_image.ff728ead-de76-47a1-8a64-87b18f1960bfnyhuaffn.img Sep 19 00:00:29 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:33 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:00:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Flow 'volume_create_manager' (5759b67d-123e-4fa6-b9bc-5e5d25ff60f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:00:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12077151-a039-4c3d-9d46-96abf7d1a278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12077151-a039-4c3d-9d46-96abf7d1a278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1391475408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3dae6b-4683-4281-bf8b-f91c2da515c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e5bbb4b08a4e2094034532e4d55e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:00:33Z,use_quota=True,user_id='c60efe2088f845ddbb8368061a1d4842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00e50a3-3dbf-4c08-ba61-aef427af803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00e50a3-3dbf-4c08-ba61-aef427af803f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (769614d5-4ce4-4c6a-b0fc-d465d0052b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (769614d5-4ce4-4c6a-b0fc-d465d0052b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3dae6b-4683-4281-bf8b-f91c2da515c5', 'volume_name': 'volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55466c1b-b75d-4312-8d61-feedcc44b33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55466c1b-b75d-4312-8d61-feedcc44b33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce76cb65-dd0a-44b8-96f7-ae93f5254d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:33 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Volume ed3dae6b-4683-4281-bf8b-f91c2da515c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5', 'volume_size': 1} Sep 19 00:00:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:37 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 /opt/stack/data/cinder/conversion/f0c4c246-6029-4e2b-ae93-f5a83a9b8557.temp_image.ff728ead-de76-47a1-8a64-87b18f1960bfnyhuaffn.img" returned: 0 in 7.605s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed27ae0e-7074-48c1-b19a-169eaf4b83ab]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:37 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 Sep 19 00:00:37 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:37 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557" returned: 0 in 0.534s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:37 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557, size 1024.00 MB, duration 7.61 sec, destination /opt/stack/data/cinder/conversion/f0c4c246-6029-4e2b-ae93-f5a83a9b8557.temp_image.ff728ead-de76-47a1-8a64-87b18f1960bfnyhuaffn.img {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 19 00:00:37 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] Converted 1024.00 MB image at 134.63 MB/s Sep 19 00:00:37 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] ff728ead-de76-47a1-8a64-87b18f1960bf was raw, no need to convert to raw {{(pid=85963) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 19 00:00:43 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=67,cinder:UPDATE=65,cinder:DELETE=4,cinder:INSERT=23 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 19 00:00:47 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=53,cinder:INSERT=24,cinder:UPDATE=71,cinder:DELETE=7 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.609s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] Uploaded volume to glance image-id: ff728ead-de76-47a1-8a64-87b18f1960bf. {{(pid=85963) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-8d20a492-5c65-4d96-9253-4e238612939f req-53696118-88ed-4e01-8c01-3934c61a5454 tempest-TestShelveInstance-1954266482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 27.695s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-8d20a492-5c65-4d96-9253-4e238612939f req-53696118-88ed-4e01-8c01-3934c61a5454 tempest-TestShelveInstance-1954266482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.655s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1391475408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3dae6b-4683-4281-bf8b-f91c2da515c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e5bbb4b08a4e2094034532e4d55e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:00:33Z,use_quota=True,user_id='c60efe2088f845ddbb8368061a1d4842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Creating volume ed3dae6b-4683-4281-bf8b-f91c2da515c5 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:00:57 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f35d16d4-e160-4507-a0dc-c6fd69849548 tempest-TestImageHashVerification-1167687063 None] Copy volume to image completed successfully. Sep 19 00:00:57 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 1073741824 Sep 19 00:00:57 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-8d20a492-5c65-4d96-9253-4e238612939f req-53696118-88ed-4e01-8c01-3934c61a5454 tempest-TestShelveInstance-1954266482 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-26203521-cbc1-41ec-adf2-17b111dc1a72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3144d34-75a8-4e12-915f-545f02eb6d5f', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 19 00:00:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-8d20a492-5c65-4d96-9253-4e238612939f req-53696118-88ed-4e01-8c01-3934c61a5454 tempest-TestShelveInstance-1954266482 None] attachment_update completed successfully. Sep 19 00:00:57 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 1073741824" returned: 0 in 0.528s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:57 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 Sep 19 00:00:57 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:58 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5" returned: 0 in 0.486s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce76cb65-dd0a-44b8-96f7-ae93f5254d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b407e9-30cc-40d4-ac76-7eb28eee5799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:00:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Volume volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 (ed3dae6b-4683-4281-bf8b-f91c2da515c5): created successfully Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b407e9-30cc-40d4-ac76-7eb28eee5799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Flow 'volume_create_manager' (5759b67d-123e-4fa6-b9bc-5e5d25ff60f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:00:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6b0adba7-f034-4e05-8b17-3f57649faff2 tempest-VolumesSnapshotListTestJSON-1715035766 None] Created volume successfully. Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Acquiring lock "cinder-f0c4c246-6029-4e2b-ae93-f5a83a9b8557-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Lock "cinder-f0c4c246-6029-4e2b-ae93-f5a83a9b8557-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Acquiring lock "cinder-quobyte-f0c4c246-6029-4e2b-ae93-f5a83a9b8557" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Lock "cinder-quobyte-f0c4c246-6029-4e2b-ae93-f5a83a9b8557" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c7f48f-bb68-43ed-97c3-43d7c478b15f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:58 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 Sep 19 00:00:58 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:59 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557" returned: 0 in 0.586s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:59 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557 Sep 19 00:00:59 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] Creating offline snapshot 4fe92232-07fa-431d-9344-313ec35361ea of volume ed3dae6b-4683-4281-bf8b-f91c2da515c5 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3a494c-ab0a-4eb4-9573-8c3683360a3c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:59 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f0c4c246-6029-4e2b-ae93-f5a83a9b8557" returned: 0 in 0.306s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Lock "cinder-quobyte-f0c4c246-6029-4e2b-ae93-f5a83a9b8557" released by "delete_volume" :: held 0.953s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Created reservations ['1472ae05-5c86-4a94-af08-1226d2a99e10', '51447163-0e5d-440e-b42e-2fb6740f8f7f', '235547fd-ea8b-407e-b6e6-2253c454c35f', '29b27c7b-6d4c-4f53-87e6-02c705bdc6a1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:00:59 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 Sep 19 00:00:59 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:59 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:00:59 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:59 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5" returned: 0 in 0.460s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:00:59 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.278s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:00:59 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea 1G Sep 19 00:00:59 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:00:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Deleted volume successfully. Sep 19 00:00:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fb149466-bd09-44e7-bd7e-9e1c8f8e9105 tempest-TestImageHashVerification-1167687063 None] Lock "cinder-f0c4c246-6029-4e2b-ae93-f5a83a9b8557-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:00 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea 1G" returned: 0 in 0.506s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:00 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea Sep 19 00:01:00 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:00 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea" returned: 0 in 0.310s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:00 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea is being set with open permissions: ugo+rw Sep 19 00:01:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:00 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea Sep 19 00:01:00 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:00 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea" returned: 0 in 0.318s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:01 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.info Sep 19 00:01:01 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:01 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.info" returned: 0 in 0.423s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:01 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.info is being set with open permissions: ugo+rw Sep 19 00:01:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:01 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.info Sep 19 00:01:01 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:01 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.info" returned: 0 in 0.426s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.591s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-859788eb-1f8e-4062-af21-a55a959a9cad tempest-VolumesSnapshotListTestJSON-1715035766 None] Create snapshot completed successfully Sep 19 00:01:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] Creating offline snapshot 14a28e03-ffc2-4dae-978b-05acee94c113 of volume ed3dae6b-4683-4281-bf8b-f91c2da515c5 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:01:02 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba10de0-5cf6-4c16-92e5-681ec56b06e4]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:03 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea Sep 19 00:01:03 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:03 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea" returned: 0 in 0.472s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:01:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:03 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 1G Sep 19 00:01:03 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:04 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 1G" returned: 0 in 0.756s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:04 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 Sep 19 00:01:04 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:04 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113" returned: 0 in 0.422s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:04 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 is being set with open permissions: ugo+rw Sep 19 00:01:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:04 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 Sep 19 00:01:04 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:04 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113" returned: 0 in 0.347s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fb561102-9afc-43a3-9f4e-b137f1b6b844 tempest-VolumesSnapshotListTestJSON-1715035766 None] Create snapshot completed successfully Sep 19 00:01:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Creating offline snapshot 377cb5fd-3453-4a49-b30c-565f0b0d2c8a of volume ed3dae6b-4683-4281-bf8b-f91c2da515c5 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:01:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cf4f04-40e6-482b-a907-f047b2fb76e7]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:06 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 Sep 19 00:01:06 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:06 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113" returned: 0 in 0.400s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:01:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:06 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a 1G Sep 19 00:01:06 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:07 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a 1G" returned: 0 in 0.605s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:07 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a Sep 19 00:01:07 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:07 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a" returned: 0 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:07 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a is being set with open permissions: ugo+rw Sep 19 00:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:07 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a Sep 19 00:01:07 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:08 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a" returned: 0 in 0.398s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ad1b582a-bc96-421c-9302-afd9e339c1e8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Create snapshot completed successfully Sep 19 00:01:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "cinder-377cb5fd-3453-4a49-b30c-565f0b0d2c8a-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-377cb5fd-3453-4a49-b30c-565f0b0d2c8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "cinder-quobyte-ed3dae6b-4683-4281-bf8b-f91c2da515c5" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-ed3dae6b-4683-4281-bf8b-f91c2da515c5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "cinder-quobyte-377cb5fd-3453-4a49-b30c-565f0b0d2c8a" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-377cb5fd-3453-4a49-b30c-565f0b0d2c8a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Deleting offline snapshot 377cb5fd-3453-4a49-b30c-565f0b0d2c8a of volume ed3dae6b-4683-4281-bf8b-f91c2da515c5 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:01:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] snapshot_file for this snap is: volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:01:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aeffe34-15c2-448c-a43c-47c1408ea9bc]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:09 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a Sep 19 00:01:09 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:09 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a" returned: 0 in 0.384s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:01:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadc86e1-cf1c-4926-a808-ed31a4736315]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:10 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 Sep 19 00:01:10 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:10 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113" returned: 0 in 0.395s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:01:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:10 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a Sep 19 00:01:10 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:10 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a" returned: 0 in 0.423s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:10 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a Sep 19 00:01:10 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:11 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.377cb5fd-3453-4a49-b30c-565f0b0d2c8a" returned: 0 in 0.382s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-377cb5fd-3453-4a49-b30c-565f0b0d2c8a" released by "_delete_snapshot" :: held 1.763s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-ed3dae6b-4683-4281-bf8b-f91c2da515c5" released by "delete_snapshot" :: held 1.792s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Created reservations ['8dbf663f-8238-4fdf-bfb2-03b1d8c3ac82', '801ca0e0-d9c4-490e-b857-997b1e25f02e', '8a0add5d-6ceb-4f83-9499-e2e97f75d4d5', '53a39133-a80b-459a-ab7d-dd3d9b85186a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Delete snapshot completed successfully. Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b88f789-31a8-49d3-ae99-522436bd2f8e tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-377cb5fd-3453-4a49-b30c-565f0b0d2c8a-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "cinder-14a28e03-ffc2-4dae-978b-05acee94c113-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-14a28e03-ffc2-4dae-978b-05acee94c113-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "cinder-quobyte-ed3dae6b-4683-4281-bf8b-f91c2da515c5" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-ed3dae6b-4683-4281-bf8b-f91c2da515c5" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "cinder-quobyte-14a28e03-ffc2-4dae-978b-05acee94c113" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-14a28e03-ffc2-4dae-978b-05acee94c113" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Deleting offline snapshot 14a28e03-ffc2-4dae-978b-05acee94c113 of volume ed3dae6b-4683-4281-bf8b-f91c2da515c5 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] snapshot_file for this snap is: volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c6f317-420a-49f1-9798-e7b6c746e58d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:11 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 Sep 19 00:01:11 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:12 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113" returned: 0 in 0.463s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:01:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71c9f98-818e-47a4-a71d-36273ca5aa09]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:12 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea Sep 19 00:01:12 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:12 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea" returned: 0 in 0.436s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:01:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:12 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 Sep 19 00:01:12 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:13 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113" returned: 0 in 0.461s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:13 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113 Sep 19 00:01:13 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:13 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.14a28e03-ffc2-4dae-978b-05acee94c113" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-14a28e03-ffc2-4dae-978b-05acee94c113" released by "_delete_snapshot" :: held 1.765s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-ed3dae6b-4683-4281-bf8b-f91c2da515c5" released by "delete_snapshot" :: held 1.797s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Created reservations ['fa43d52c-d77b-4c3f-858e-d21bf7f45429', 'c725df1a-9f6d-4137-8f3e-2ef0a9cbdc52', '3cb366d9-e037-46ae-91f4-caa0f4a05716', 'c58a2770-0cee-4d85-a762-db0637e058bd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Delete snapshot completed successfully. Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ada5be56-b814-4a65-91d7-795474ec93dd tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-14a28e03-ffc2-4dae-978b-05acee94c113-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "cinder-4fe92232-07fa-431d-9344-313ec35361ea-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-4fe92232-07fa-431d-9344-313ec35361ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "cinder-quobyte-ed3dae6b-4683-4281-bf8b-f91c2da515c5" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-ed3dae6b-4683-4281-bf8b-f91c2da515c5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "cinder-quobyte-4fe92232-07fa-431d-9344-313ec35361ea" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-4fe92232-07fa-431d-9344-313ec35361ea" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Deleting offline snapshot 4fe92232-07fa-431d-9344-313ec35361ea of volume ed3dae6b-4683-4281-bf8b-f91c2da515c5 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] snapshot_file for this snap is: volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7f8aca-407c-4a8a-8644-fb7d97d47083]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:14 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea Sep 19 00:01:14 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:14 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea" returned: 0 in 0.471s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:01:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[153a407f-967a-45eb-aad3-28a4626d4cf4]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:14 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 Sep 19 00:01:14 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:14 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5" returned: 0 in 0.422s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:14 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea Sep 19 00:01:14 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:15 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea" returned: 0 in 0.447s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:15 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea Sep 19 00:01:15 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:15 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5.4fe92232-07fa-431d-9344-313ec35361ea" returned: 0 in 0.374s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-4fe92232-07fa-431d-9344-313ec35361ea" released by "_delete_snapshot" :: held 1.883s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-ed3dae6b-4683-4281-bf8b-f91c2da515c5" released by "delete_snapshot" :: held 1.924s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Flow 'volume_create_manager' (d5e508e1-d967-4dfe-b5fb-f222ae9e539a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9afbce-0e4c-4348-8e9b-1d20a6190839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9afbce-0e4c-4348-8e9b-1d20a6190839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1216466827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7c0a4d-2021-43e1-bd33-24e778a213f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5665ed86f28444408e6e468ce8308f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:16Z,use_quota=True,user_id='f4698f77a13f435fa56826f8d4bf6f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750eda80-4ed3-4fbd-8fbb-0f3a2e5ac0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750eda80-4ed3-4fbd-8fbb-0f3a2e5ac0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3303981-ab13-4bdd-b083-784d705502fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3303981-ab13-4bdd-b083-784d705502fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a7c0a4d-2021-43e1-bd33-24e778a213f7', 'volume_name': 'volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40124e8-5964-460c-904f-6c4d8728f7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40124e8-5964-460c-904f-6c4d8728f7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a355ce-c3af-4c64-8f9a-766b56f07d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:15 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume 3a7c0a4d-2021-43e1-bd33-24e778a213f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7', 'volume_size': 1} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1216466827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7c0a4d-2021-43e1-bd33-24e778a213f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5665ed86f28444408e6e468ce8308f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:16Z,use_quota=True,user_id='f4698f77a13f435fa56826f8d4bf6f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Creating volume 3a7c0a4d-2021-43e1-bd33-24e778a213f7 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:15 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:15 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 1073741824 Sep 19 00:01:15 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:15 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Created reservations ['dd1c31bd-5a6c-4960-bbcc-e6c9a9db2d0d', '63153fc5-37f5-48ad-8205-184f974c9afa', 'b87dac9f-ec1b-44d0-a2ca-63c2a330685b', '60814cf0-573e-4e76-a143-a43372debb43'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Delete snapshot completed successfully. Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2b702fa-7ef1-4e8e-9bdd-2a85cc2276bf tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-4fe92232-07fa-431d-9344-313ec35361ea-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "cinder-ed3dae6b-4683-4281-bf8b-f91c2da515c5-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-ed3dae6b-4683-4281-bf8b-f91c2da515c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "cinder-quobyte-ed3dae6b-4683-4281-bf8b-f91c2da515c5" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-ed3dae6b-4683-4281-bf8b-f91c2da515c5" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:16 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 1073741824" returned: 0 in 0.681s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3613fa77-c2aa-4cb6-9b97-08b0e0d026a7]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:16 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 Sep 19 00:01:16 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:16 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 Sep 19 00:01:16 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:16 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7" returned: 0 in 0.278s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a355ce-c3af-4c64-8f9a-766b56f07d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569d899b-5f5f-4c99-ab69-adef4f0c44f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:16 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 (3a7c0a4d-2021-43e1-bd33-24e778a213f7): created successfully Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569d899b-5f5f-4c99-ab69-adef4f0c44f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Flow 'volume_create_manager' (d5e508e1-d967-4dfe-b5fb-f222ae9e539a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5dce4bee-0f6b-4c6f-be04-a047af26e3e7 tempest-CreateVolumesFromSnapshotTest-817029046 None] Created volume successfully. Sep 19 00:01:17 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5" returned: 0 in 0.424s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:17 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5 Sep 19 00:01:17 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:17 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ed3dae6b-4683-4281-bf8b-f91c2da515c5" returned: 0 in 0.270s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-quobyte-ed3dae6b-4683-4281-bf8b-f91c2da515c5" released by "delete_volume" :: held 0.788s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Created reservations ['df96b908-5cbc-48dd-bde9-bef03a578264', 'a336ebac-9d83-4a8e-87ed-db07fb431855', 'd795756f-5ed3-41c2-a367-a237f2f20cbd', '9287cf15-4a4c-4dfc-8d2e-3c8e2b7936bd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:17 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:17 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:17 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.252s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Deleted volume successfully. Sep 19 00:01:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0e8b26f-c63e-4c4e-b71d-7f51e9169df8 tempest-VolumesSnapshotListTestJSON-1715035766 None] Lock "cinder-ed3dae6b-4683-4281-bf8b-f91c2da515c5-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] Creating offline snapshot 56013aa5-56b9-40ed-8288-03c9615d8a58 of volume 3a7c0a4d-2021-43e1-bd33-24e778a213f7 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:01:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0f6928-45a7-4e2b-982d-3eb15a62c179]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:18 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 Sep 19 00:01:18 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:18 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7" returned: 0 in 0.371s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:18 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 1G Sep 19 00:01:18 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:18 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 1G" returned: 0 in 0.430s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:18 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 Sep 19 00:01:18 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:19 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:19 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 is being set with open permissions: ugo+rw Sep 19 00:01:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:19 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 Sep 19 00:01:19 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:19 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58" returned: 0 in 0.266s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:19 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.info Sep 19 00:01:19 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:19 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.info" returned: 0 in 0.260s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:19 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.info is being set with open permissions: ugo+rw Sep 19 00:01:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:19 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.info Sep 19 00:01:19 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:20 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.info" returned: 0 in 0.246s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7e21f517-3235-4b77-b03c-00bf0a9f1aa5 tempest-CreateVolumesFromSnapshotTest-817029046 None] Create snapshot completed successfully Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Flow 'volume_create_manager' (f937227e-f2e5-4fb4-bcf3-a2fba447ea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bde84b4-ba1f-44d0-b1cf-485cd19a1e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bde84b4-ba1f-44d0-b1cf-485cd19a1e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1249267391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5665ed86f28444408e6e468ce8308f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:21Z,use_quota=True,user_id='f4698f77a13f435fa56826f8d4bf6f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b7e02a-5b88-4b88-a300-b9cf7e4f8bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b7e02a-5b88-4b88-a300-b9cf7e4f8bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e94874-d0e5-4895-81a0-b533c7a744ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e94874-d0e5-4895-81a0-b533c7a744ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3', 'volume_name': 'volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b4b56d-d3b2-4960-9da2-933c878d15a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45b4b56d-d3b2-4960-9da2-933c878d15a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663c6bbe-622f-43a7-8263-fd4c13e882e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3', 'volume_size': 1} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1249267391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5665ed86f28444408e6e468ce8308f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:21Z,use_quota=True,user_id='f4698f77a13f435fa56826f8d4bf6f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Creating volume ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:20 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:20 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3 1073741824 Sep 19 00:01:20 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Flow 'volume_create_manager' (f63a2fc6-2d94-4b59-822b-7b891683a276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48db19e2-148e-4b95-a0d0-ca5e92803fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48db19e2-148e-4b95-a0d0-ca5e92803fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-670171467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b234b9-fbce-4c80-8c8b-e5d68b3dd97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5665ed86f28444408e6e468ce8308f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:21Z,use_quota=True,user_id='f4698f77a13f435fa56826f8d4bf6f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78097c19-8c76-4a7e-b877-0acb6fda9a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78097c19-8c76-4a7e-b877-0acb6fda9a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65dda488-525c-4ce8-bf49-d36cafab3174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65dda488-525c-4ce8-bf49-d36cafab3174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b234b9-fbce-4c80-8c8b-e5d68b3dd97e', 'volume_name': 'volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a6472b-f8b2-477e-98ef-70d9e93e512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a6472b-f8b2-477e-98ef-70d9e93e512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e83403b-9589-42ca-b34b-de979e266779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume 75b234b9-fbce-4c80-8c8b-e5d68b3dd97e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e', 'volume_size': 1} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:21 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:21 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:21 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3 1073741824" returned: 0 in 0.615s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:21 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3 Sep 19 00:01:21 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Flow 'volume_create_manager' (11aa8ef5-a246-42f4-942f-45e276d53502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5eabff8-7d98-4dcf-a0fd-9e0f2ebd668a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5eabff8-7d98-4dcf-a0fd-9e0f2ebd668a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1524188131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe56397-2c94-4c89-adb8-954a0171a83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5665ed86f28444408e6e468ce8308f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:21Z,use_quota=True,user_id='f4698f77a13f435fa56826f8d4bf6f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eeeb7cd-7675-4621-8bb3-e05790f403ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eeeb7cd-7675-4621-8bb3-e05790f403ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8c3800-1018-42f5-991e-9b2e3d764b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8c3800-1018-42f5-991e-9b2e3d764b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe56397-2c94-4c89-adb8-954a0171a83e', 'volume_name': 'volume-cfe56397-2c94-4c89-adb8-954a0171a83e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfaeb72-aaf0-43e2-a20b-a1af4eafab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfaeb72-aaf0-43e2-a20b-a1af4eafab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b987fac4-43d6-4fca-9687-92f085a2aea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume cfe56397-2c94-4c89-adb8-954a0171a83e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe56397-2c94-4c89-adb8-954a0171a83e', 'volume_size': 1} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:21 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.363s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 29 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 19 00:01:21 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3" returned: 0 in 0.268s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-670171467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b234b9-fbce-4c80-8c8b-e5d68b3dd97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5665ed86f28444408e6e468ce8308f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:21Z,use_quota=True,user_id='f4698f77a13f435fa56826f8d4bf6f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Creating volume 75b234b9-fbce-4c80-8c8b-e5d68b3dd97e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:21 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663c6bbe-622f-43a7-8263-fd4c13e882e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:21 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e 1073741824 Sep 19 00:01:21 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69225083-8fa2-4ff4-84ad-bff8d82652ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3 (ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3): created successfully Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69225083-8fa2-4ff4-84ad-bff8d82652ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Flow 'volume_create_manager' (f937227e-f2e5-4fb4-bcf3-a2fba447ea06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-24e5d329-5608-47d7-9337-7e26dd912920 tempest-CreateVolumesFromSnapshotTest-817029046 None] Created volume successfully. Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Flow 'volume_create_manager' (989739ae-82a6-4658-864a-b670e7ab9ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e263955-7f9f-4c82-80fe-0f862df59d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e263955-7f9f-4c82-80fe-0f862df59d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1283024777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bfd8fc-4742-4ae9-a821-c610a392072a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5665ed86f28444408e6e468ce8308f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:22Z,use_quota=True,user_id='f4698f77a13f435fa56826f8d4bf6f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115c01e3-f037-4b2d-a32c-57735b743003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115c01e3-f037-4b2d-a32c-57735b743003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d6ddc5-b282-4103-968e-41b222a38573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d6ddc5-b282-4103-968e-41b222a38573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54bfd8fc-4742-4ae9-a821-c610a392072a', 'volume_name': 'volume-54bfd8fc-4742-4ae9-a821-c610a392072a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (929c2914-fd73-4b97-ba88-6d48dd4f31ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (929c2914-fd73-4b97-ba88-6d48dd4f31ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e597bd9c-02d1-477d-9f89-91fa665ae959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume 54bfd8fc-4742-4ae9-a821-c610a392072a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54bfd8fc-4742-4ae9-a821-c610a392072a', 'volume_size': 1} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:22 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e 1073741824" returned: 0 in 0.644s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:22 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e Sep 19 00:01:22 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Flow 'volume_create_manager' (120e7d80-d50f-4731-aebc-bd317478d2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c3dc1c-fd2a-47ba-a378-3a771c7e68cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c3dc1c-fd2a-47ba-a378-3a771c7e68cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1625667322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94c26f6-41b9-42ee-b35c-9ae9c194c485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5665ed86f28444408e6e468ce8308f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:22Z,use_quota=True,user_id='f4698f77a13f435fa56826f8d4bf6f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8182be7b-b0cf-47fb-8468-3978c94f6d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8182be7b-b0cf-47fb-8468-3978c94f6d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf8638d-b7ed-4377-8296-37b0339ea94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf8638d-b7ed-4377-8296-37b0339ea94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94c26f6-41b9-42ee-b35c-9ae9c194c485', 'volume_name': 'volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30737d4f-b681-49bd-bf0f-727a340473b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30737d4f-b681-49bd-bf0f-727a340473b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e46ac9-6b7c-41ab-8fee-682f67c1405a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume d94c26f6-41b9-42ee-b35c-9ae9c194c485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485', 'volume_size': 1} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:22 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e" returned: 0 in 0.255s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.084s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1524188131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe56397-2c94-4c89-adb8-954a0171a83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5665ed86f28444408e6e468ce8308f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:21Z,use_quota=True,user_id='f4698f77a13f435fa56826f8d4bf6f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Creating volume cfe56397-2c94-4c89-adb8-954a0171a83e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:22 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cfe56397-2c94-4c89-adb8-954a0171a83e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:22 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cfe56397-2c94-4c89-adb8-954a0171a83e 1073741824 Sep 19 00:01:22 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e83403b-9589-42ca-b34b-de979e266779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2e3e41-e153-4691-8ddc-38a6d6c628ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e (75b234b9-fbce-4c80-8c8b-e5d68b3dd97e): created successfully Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2e3e41-e153-4691-8ddc-38a6d6c628ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Flow 'volume_create_manager' (f63a2fc6-2d94-4b59-822b-7b891683a276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ddad187e-8200-4f13-84d0-20d5b54f6887 tempest-CreateVolumesFromSnapshotTest-817029046 None] Created volume successfully. Sep 19 00:01:23 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cfe56397-2c94-4c89-adb8-954a0171a83e 1073741824" returned: 0 in 0.486s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cfe56397-2c94-4c89-adb8-954a0171a83e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:23 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cfe56397-2c94-4c89-adb8-954a0171a83e Sep 19 00:01:23 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:23 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cfe56397-2c94-4c89-adb8-954a0171a83e" returned: 0 in 0.332s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.226s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1283024777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bfd8fc-4742-4ae9-a821-c610a392072a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5665ed86f28444408e6e468ce8308f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:22Z,use_quota=True,user_id='f4698f77a13f435fa56826f8d4bf6f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Creating volume 54bfd8fc-4742-4ae9-a821-c610a392072a {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:23 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-54bfd8fc-4742-4ae9-a821-c610a392072a 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b987fac4-43d6-4fca-9687-92f085a2aea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe56397-2c94-4c89-adb8-954a0171a83e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb83339-5650-4b84-b5d2-5d07cd87bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:23 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-54bfd8fc-4742-4ae9-a821-c610a392072a 1073741824 Sep 19 00:01:23 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume volume-cfe56397-2c94-4c89-adb8-954a0171a83e (cfe56397-2c94-4c89-adb8-954a0171a83e): created successfully Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb83339-5650-4b84-b5d2-5d07cd87bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Flow 'volume_create_manager' (11aa8ef5-a246-42f4-942f-45e276d53502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c7831a66-6d4b-46cc-9fb7-021211bc4abe tempest-CreateVolumesFromSnapshotTest-817029046 None] Created volume successfully. Sep 19 00:01:24 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-54bfd8fc-4742-4ae9-a821-c610a392072a 1073741824" returned: 0 in 0.558s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-54bfd8fc-4742-4ae9-a821-c610a392072a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:24 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-54bfd8fc-4742-4ae9-a821-c610a392072a Sep 19 00:01:24 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:24 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-54bfd8fc-4742-4ae9-a821-c610a392072a" returned: 0 in 0.258s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.863s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1625667322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94c26f6-41b9-42ee-b35c-9ae9c194c485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5665ed86f28444408e6e468ce8308f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:22Z,use_quota=True,user_id='f4698f77a13f435fa56826f8d4bf6f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Creating volume d94c26f6-41b9-42ee-b35c-9ae9c194c485 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:24 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e597bd9c-02d1-477d-9f89-91fa665ae959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54bfd8fc-4742-4ae9-a821-c610a392072a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32070b1-8e4c-40a0-9fb2-05f26342ba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:24 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485 1073741824 Sep 19 00:01:24 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:24 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume volume-54bfd8fc-4742-4ae9-a821-c610a392072a (54bfd8fc-4742-4ae9-a821-c610a392072a): created successfully Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32070b1-8e4c-40a0-9fb2-05f26342ba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Flow 'volume_create_manager' (989739ae-82a6-4658-864a-b670e7ab9ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7a8f12a4-028f-4b80-9403-e8bbd6319caf tempest-CreateVolumesFromSnapshotTest-817029046 None] Created volume successfully. Sep 19 00:01:25 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485 1073741824" returned: 0 in 0.514s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Flow 'volume_create_manager' (840db415-fba2-41c1-b1fa-58ae175cc98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81247d7-6fa7-45f6-bf8d-dbc7329f08c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81247d7-6fa7-45f6-bf8d-dbc7329f08c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf24b693-4f56-4550-ac0f-6fa128802fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9d058d8a7b4f72b876293590f2dcf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:25Z,use_quota=True,user_id='e1755aa5d1914a34b2f96bdc7cfa3cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4647aeef-1213-4fc2-88d9-723c62098b2a),volume_type_id=4647aeef-1213-4fc2-88d9-723c62098b2a)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e09132f-4517-4274-b2f7-fb57f906d693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e09132f-4517-4274-b2f7-fb57f906d693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2766a36-35e5-4f95-bee0-79f1202d8d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:25 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485 Sep 19 00:01:25 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:25 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485" returned: 0 in 0.279s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e46ac9-6b7c-41ab-8fee-682f67c1405a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc64cd1c-80c1-473f-8631-56cd335fc6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Volume volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485 (d94c26f6-41b9-42ee-b35c-9ae9c194c485): created successfully Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc64cd1c-80c1-473f-8631-56cd335fc6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Flow 'volume_create_manager' (120e7d80-d50f-4731-aebc-bd317478d2d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0b83760a-1f5a-4d3b-b003-ce65e486a591 tempest-CreateVolumesFromSnapshotTest-817029046 None] Created volume successfully. Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2766a36-35e5-4f95-bee0-79f1202d8d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf24b693-4f56-4550-ac0f-6fa128802fff', 'volume_name': 'volume-bf24b693-4f56-4550-ac0f-6fa128802fff', 'volume_size': 1, 'image_id': '778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1440a7898f95aca01fa3a486c95583b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc9d058d8a7b4f72b876293590f2dcf9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6a579d559bdd85d114ea950805e208b93ca2533d3a447a92066f8e60f5b47eb6da970f1d3d56b620120a3a57c315b43fbefad78a05d5cf6d476d330420a2a0f', 'id': '778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'created_at': datetime.datetime(2026, 9, 18, 22, 1, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 22, 1, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/778ce6f0-fa3d-4ee1-af55-044ad64c6b14/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19873f5-775b-41f4-af27-e02b0dc42b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19873f5-775b-41f4-af27-e02b0dc42b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260a1ed5-651a-41fc-a6ae-e1e6e83d14a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Volume bf24b693-4f56-4550-ac0f-6fa128802fff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf24b693-4f56-4550-ac0f-6fa128802fff', 'volume_size': 1, 'image_id': '778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1440a7898f95aca01fa3a486c95583b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc9d058d8a7b4f72b876293590f2dcf9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6a579d559bdd85d114ea950805e208b93ca2533d3a447a92066f8e60f5b47eb6da970f1d3d56b620120a3a57c315b43fbefad78a05d5cf6d476d330420a2a0f', 'id': '778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'created_at': datetime.datetime(2026, 9, 18, 22, 1, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 22, 1, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/778ce6f0-fa3d-4ee1-af55-044ad64c6b14/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Trying to clone bf24b693-4f56-4550-ac0f-6fa128802fff from image 778ce6f0-fa3d-4ee1-af55-044ad64c6b14 at location (None, [{'url': 'file:///opt/stack/data/glance/images/778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 19 00:01:25 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Image download 0.00 MB at 0.00 MB/s Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bce5d52-2d5f-444b-9464-dfb368bbd78f]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:25 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD Sep 19 00:01:25 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-d94c26f6-41b9-42ee-b35c-9ae9c194c485-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-d94c26f6-41b9-42ee-b35c-9ae9c194c485-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:26 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-quobyte-d94c26f6-41b9-42ee-b35c-9ae9c194c485" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-d94c26f6-41b9-42ee-b35c-9ae9c194c485" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccd71b5-5dd3-4658-bd8f-aee054897302]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:26 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD Sep 19 00:01:26 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:26 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485 Sep 19 00:01:26 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:26 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Temporary image 778ce6f0-fa3d-4ee1-af55-044ad64c6b14 is fetched for user e1755aa5d1914a34b2f96bdc7cfa3cb0. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[34860686-5445-459b-b653-1c089c29b8d0]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:26 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485" returned: 0 in 0.425s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:26 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485 Sep 19 00:01:26 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:26 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD Sep 19 00:01:26 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:26 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d94c26f6-41b9-42ee-b35c-9ae9c194c485" returned: 0 in 0.284s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-d94c26f6-41b9-42ee-b35c-9ae9c194c485" released by "delete_volume" :: held 0.757s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:26 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Created reservations ['a2f21f50-b0a4-464f-ae68-9d0ce21407a9', '54ef0ea0-3567-4d36-87c3-9eb32b888f71', '7ce1c487-e67d-420a-b4bb-f76bef3dd93d', 'f88e8860-0247-4732-b304-50ffdef93dbf'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:27 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD Sep 19 00:01:27 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:27 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:27 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-54bfd8fc-4742-4ae9-a821-c610a392072a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-54bfd8fc-4742-4ae9-a821-c610a392072a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-quobyte-54bfd8fc-4742-4ae9-a821-c610a392072a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-54bfd8fc-4742-4ae9-a821-c610a392072a" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0adc13c-078a-40a3-aed5-7c57aca3cc19]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-54bfd8fc-4742-4ae9-a821-c610a392072a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:27 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:27 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Deleted volume successfully. Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD" returned: 1 in 0.471s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf24b693-4f56-4550-ac0f-6fa128802fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9d058d8a7b4f72b876293590f2dcf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:25Z,use_quota=True,user_id='e1755aa5d1914a34b2f96bdc7cfa3cb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4647aeef-1213-4fc2-88d9-723c62098b2a),volume_type_id=4647aeef-1213-4fc2-88d9-723c62098b2a)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Creating volume bf24b693-4f56-4550-ac0f-6fa128802fff {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:27 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:27 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff 1073741824 Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d48b861d-7973-4567-8a2d-46552d6c7ee4 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-d94c26f6-41b9-42ee-b35c-9ae9c194c485-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:27 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:27 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-54bfd8fc-4742-4ae9-a821-c610a392072a Sep 19 00:01:27 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:27 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-54bfd8fc-4742-4ae9-a821-c610a392072a" returned: 0 in 0.489s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-54bfd8fc-4742-4ae9-a821-c610a392072a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:27 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-54bfd8fc-4742-4ae9-a821-c610a392072a Sep 19 00:01:27 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:27 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff 1073741824" returned: 0 in 0.595s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:28 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff Sep 19 00:01:28 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:28 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-54bfd8fc-4742-4ae9-a821-c610a392072a" returned: 0 in 0.301s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-54bfd8fc-4742-4ae9-a821-c610a392072a" released by "delete_volume" :: held 0.852s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Created reservations ['e32ededa-3943-41db-98d4-2d9d282f5a93', '2ffba80e-f53d-4d8f-8c4a-c7c4bff5b090', 'c5e5a5a1-5926-4ddc-a874-4f187828f683', 'fb8225ad-7b43-4705-8139-d3224b573f58'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:28 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff" returned: 0 in 0.336s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:28 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:28 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-cfe56397-2c94-4c89-adb8-954a0171a83e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Attempting download of 778ce6f0-fa3d-4ee1-af55-044ad64c6b14 ((None, [{'url': 'file:///opt/stack/data/glance/images/778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'metadata': {}}])) to volume bf24b693-4f56-4550-ac0f-6fa128802fff. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-cfe56397-2c94-4c89-adb8-954a0171a83e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d0cece-d16c-48bb-a0a9-922e6ec4485c]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_w7zj1ii1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-quobyte-cfe56397-2c94-4c89-adb8-954a0171a83e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-cfe56397-2c94-4c89-adb8-954a0171a83e" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[149086db-9d42-4915-9505-24a1e3102cc6]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cfe56397-2c94-4c89-adb8-954a0171a83e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:28 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_w7zj1ii1 Sep 19 00:01:28 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:28 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.316s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Deleted volume successfully. Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-70db0aa0-49ce-49ca-96e2-b6ffcf9a8b10 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-54bfd8fc-4742-4ae9-a821-c610a392072a-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:28 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cfe56397-2c94-4c89-adb8-954a0171a83e Sep 19 00:01:28 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:28 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_w7zj1ii1" returned: 0 in 0.371s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_w7zj1ii1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:28 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cfe56397-2c94-4c89-adb8-954a0171a83e" returned: 0 in 0.411s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cfe56397-2c94-4c89-adb8-954a0171a83e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:28 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_w7zj1ii1 Sep 19 00:01:28 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:29 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cfe56397-2c94-4c89-adb8-954a0171a83e Sep 19 00:01:29 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:29 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_w7zj1ii1" returned: 1 in 0.430s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_w7zj1ii1' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:01:29 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c811529-d3be-4050-925d-fb963b96ebae]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cfe56397-2c94-4c89-adb8-954a0171a83e" returned: 0 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-cfe56397-2c94-4c89-adb8-954a0171a83e" released by "delete_volume" :: held 0.801s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Created reservations ['03c09f28-ca73-4d1b-ac01-d1ccc34a1633', '430bf2fc-0492-477f-a98f-459386e811de', '791bbb3d-0535-43b9-86ac-c66fda064258', 'ac808985-055c-4bbb-891e-fce1136654e1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:29 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD Sep 19 00:01:29 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:29 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:29 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-quobyte-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:29 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD" returned: 0 in 0.640s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c67d6b-8bf0-4d69-a9b0-8d679c4cfd5a]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:30 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.551s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Deleted volume successfully. Sep 19 00:01:30 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD Sep 19 00:01:30 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a8d110d7-5c83-47ec-93f6-51d930141bd8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-cfe56397-2c94-4c89-adb8-954a0171a83e-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-37e0fbf5-6ad8-4475-b71c-23778f951322 req-0be71451-57e6-4a6e-947f-95d0700473e2 tempest-TestShelveInstance-1954266482 None] Terminate volume connection completed successfully. Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-37e0fbf5-6ad8-4475-b71c-23778f951322 req-0be71451-57e6-4a6e-947f-95d0700473e2 tempest-TestShelveInstance-1954266482 None] Deleting attachment a3144d34-75a8-4e12-915f-545f02eb6d5f. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 19 00:01:30 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e Sep 19 00:01:30 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:30 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] 778ce6f0-fa3d-4ee1-af55-044ad64c6b14 was raw, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:30 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff Sep 19 00:01:30 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:30 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e" returned: 0 in 0.549s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:30 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e Sep 19 00:01:30 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:30 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e" returned: 0 in 0.314s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e" released by "delete_volume" :: held 0.938s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Created reservations ['57349b0c-0569-4669-a2f3-a782e5f9eaa5', 'd8c11c93-8595-44a7-9632-977431c55bd5', '34ab88ba-4d34-4b62-a1ee-b695d6e09be6', 'dd742a9f-865a-43c9-bdde-bc47a2a49f95'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:30 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff" returned: 0 in 0.638s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_778ce6f0-fa3d-4ee1-af55-044ad64c6b14_80_z5chkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 19 00:01:30 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Converted 0.00 MB image at 0.00 MB/s Sep 19 00:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:30 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:30 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:31 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff 1G Sep 19 00:01:31 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:31 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.267s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Deleted volume successfully. Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1a02645f-4d70-40ee-8ee7-08e332f653a8 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-75b234b9-fbce-4c80-8c8b-e5d68b3dd97e-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:31 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff 1G" returned: 0 in 0.344s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Downloaded image 778ce6f0-fa3d-4ee1-af55-044ad64c6b14 ((None, [{'url': 'file:///opt/stack/data/glance/images/778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'metadata': {}}])) to volume bf24b693-4f56-4550-ac0f-6fa128802fff successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Temporary image 778ce6f0-fa3d-4ee1-af55-044ad64c6b14 for user e1755aa5d1914a34b2f96bdc7cfa3cb0 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Marking volume bf24b693-4f56-4550-ac0f-6fa128802fff as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Copying metadata from image 778ce6f0-fa3d-4ee1-af55-044ad64c6b14 to bf24b693-4f56-4550-ac0f-6fa128802fff. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Creating volume glance metadata for volume bf24b693-4f56-4550-ac0f-6fa128802fff backed by image 778ce6f0-fa3d-4ee1-af55-044ad64c6b14 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1440a7898f95aca01fa3a486c95583b7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260a1ed5-651a-41fc-a6ae-e1e6e83d14a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf24b693-4f56-4550-ac0f-6fa128802fff', 'volume_size': 1, 'image_id': '778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1440a7898f95aca01fa3a486c95583b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc9d058d8a7b4f72b876293590f2dcf9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd6a579d559bdd85d114ea950805e208b93ca2533d3a447a92066f8e60f5b47eb6da970f1d3d56b620120a3a57c315b43fbefad78a05d5cf6d476d330420a2a0f', 'id': '778ce6f0-fa3d-4ee1-af55-044ad64c6b14', 'created_at': datetime.datetime(2026, 9, 18, 22, 1, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 22, 1, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/778ce6f0-fa3d-4ee1-af55-044ad64c6b14/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a863d326-f5aa-43af-9d09-0085a1196b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:31 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Volume volume-bf24b693-4f56-4550-ac0f-6fa128802fff (bf24b693-4f56-4550-ac0f-6fa128802fff): created successfully Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a863d326-f5aa-43af-9d09-0085a1196b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Flow 'volume_create_manager' (840db415-fba2-41c1-b1fa-58ae175cc98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f279f0c7-fbf2-410d-8107-c991aee7cd91 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Created volume successfully. Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-quobyte-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55894f9-7f6c-4294-a30f-4b9d0fda40ae]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:32 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3 Sep 19 00:01:32 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Acquiring lock "cinder-bf24b693-4f56-4550-ac0f-6fa128802fff-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Lock "cinder-bf24b693-4f56-4550-ac0f-6fa128802fff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Acquiring lock "cinder-quobyte-bf24b693-4f56-4550-ac0f-6fa128802fff" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:32 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3" returned: 0 in 0.418s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Lock "cinder-quobyte-bf24b693-4f56-4550-ac0f-6fa128802fff" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:32 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3 Sep 19 00:01:32 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee991d4-ba92-4dc2-a440-223fcd3fd26d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:32 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff Sep 19 00:01:32 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:32 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3" returned: 0 in 0.276s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3" released by "delete_volume" :: held 0.758s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Created reservations ['5c609b99-1ec6-4a6d-945a-17fe3ecf9e66', 'b1ffa56e-478b-4152-8f6b-bb8f485fa1dc', 'e212f45d-212a-4fdf-b885-0ab42079c9e5', '540d3773-2f2d-4e8f-bc39-9cdb1fe76a58'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:33 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:33 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:33 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff" returned: 0 in 0.423s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:33 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff Sep 19 00:01:33 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-56013aa5-56b9-40ed-8288-03c9615d8a58-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-56013aa5-56b9-40ed-8288-03c9615d8a58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-quobyte-3a7c0a4d-2021-43e1-bd33-24e778a213f7" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-3a7c0a4d-2021-43e1-bd33-24e778a213f7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-quobyte-56013aa5-56b9-40ed-8288-03c9615d8a58" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-56013aa5-56b9-40ed-8288-03c9615d8a58" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Deleting offline snapshot 56013aa5-56b9-40ed-8288-03c9615d8a58 of volume 3a7c0a4d-2021-43e1-bd33-24e778a213f7 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] snapshot_file for this snap is: volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[90232ae7-87f2-4b6f-a533-b6ebdf86a593]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:33 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.362s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Deleted volume successfully. Sep 19 00:01:33 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf24b693-4f56-4550-ac0f-6fa128802fff" returned: 0 in 0.361s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Lock "cinder-quobyte-bf24b693-4f56-4550-ac0f-6fa128802fff" released by "delete_volume" :: held 0.853s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-248e58aa-a8f6-4af0-b442-d81a3224b397 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-ee0ae2d2-91df-4ee6-b392-b1aa1e7a70d3-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-cc1a52d4-9a37-4aa6-9e1b-6a29241638fa req-0b204e88-9435-4f98-a5ad-7a5af04e2bf6 tempest-TestShelveInstance-1954266482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-cc1a52d4-9a37-4aa6-9e1b-6a29241638fa req-0b204e88-9435-4f98-a5ad-7a5af04e2bf6 tempest-TestShelveInstance-1954266482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-cc1a52d4-9a37-4aa6-9e1b-6a29241638fa req-0b204e88-9435-4f98-a5ad-7a5af04e2bf6 tempest-TestShelveInstance-1954266482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:33 devstack cinder-volume[85963]: WARNING cinder.quota [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 19 00:01:33 devstack cinder-volume[85963]: WARNING cinder.quota [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 19 00:01:33 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 Sep 19 00:01:33 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Created reservations ['923faa27-8eb0-4c40-889a-999295f79fb4', '0103281f-32f7-4af9-bb87-cd652c39ea23', 'e98eef21-5871-4efa-a892-ca458bc54552', '72876833-fd6e-4aff-944a-eaf92668386d'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-cc1a52d4-9a37-4aa6-9e1b-6a29241638fa req-0b204e88-9435-4f98-a5ad-7a5af04e2bf6 tempest-TestShelveInstance-1954266482 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b', 'name': 'volume-26203521-cbc1-41ec-adf2-17b111dc1a72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb247cc5-7795-4758-b436-71bcbeac185e', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 19 00:01:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-cc1a52d4-9a37-4aa6-9e1b-6a29241638fa req-0b204e88-9435-4f98-a5ad-7a5af04e2bf6 tempest-TestShelveInstance-1954266482 None] attachment_update completed successfully. Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:33 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:33 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:33 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58" returned: 0 in 0.494s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cb2cba-268b-44c4-a72e-269b1642ab34]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:34 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.366s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:34 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Deleted volume successfully. Sep 19 00:01:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0d64ce3-d8fe-4538-a6dc-390dfb01eef0 tempest-VolumeAndVolumeTypeFromImageTest-719440052 None] Lock "cinder-bf24b693-4f56-4550-ac0f-6fa128802fff-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:34 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 Sep 19 00:01:34 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:34 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7" returned: 0 in 0.467s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:34 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 Sep 19 00:01:34 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:34 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58" returned: 0 in 0.439s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:34 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58 Sep 19 00:01:34 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:35 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7.56013aa5-56b9-40ed-8288-03c9615d8a58" returned: 0 in 0.277s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-56013aa5-56b9-40ed-8288-03c9615d8a58" released by "_delete_snapshot" :: held 1.850s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-3a7c0a4d-2021-43e1-bd33-24e778a213f7" released by "delete_snapshot" :: held 1.893s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:35 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Created reservations ['4e07d45d-14e8-44ef-9c36-6c8e70a96e34', '326359f8-a390-42f4-99bb-bee69251a606', '6b849f25-35a4-4792-ac0c-2e120cb91062', 'ac1d404b-fb4f-47f0-9d30-79880f267fc7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Delete snapshot completed successfully. Sep 19 00:01:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e1953d16-c80b-4643-b314-5c98b5d5ddd1 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-56013aa5-56b9-40ed-8288-03c9615d8a58-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-3a7c0a4d-2021-43e1-bd33-24e778a213f7-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-3a7c0a4d-2021-43e1-bd33-24e778a213f7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "cinder-quobyte-3a7c0a4d-2021-43e1-bd33-24e778a213f7" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-3a7c0a4d-2021-43e1-bd33-24e778a213f7" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:35 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[29453524-e449-4dd1-9080-7710eebd24fe]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:35 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 Sep 19 00:01:35 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:36 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7" returned: 0 in 0.399s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:36 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7 Sep 19 00:01:36 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:36 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3a7c0a4d-2021-43e1-bd33-24e778a213f7" returned: 0 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-quobyte-3a7c0a4d-2021-43e1-bd33-24e778a213f7" released by "delete_volume" :: held 0.842s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:36 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Created reservations ['db39177b-6772-48e3-9dd7-9068d970d798', 'e87850ac-0a98-4034-9603-550aa8d91f73', '8101b205-a8f6-46aa-ab28-f3dbb2573006', 'c11c2e7f-7f7b-4dc8-8fee-1beb29f3a24a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:36 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:36 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:37 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.549s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:37 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Deleted volume successfully. Sep 19 00:01:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-101836a7-c27d-4215-82df-9cb16bdda567 tempest-CreateVolumesFromSnapshotTest-817029046 None] Lock "cinder-3a7c0a4d-2021-43e1-bd33-24e778a213f7-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Flow 'volume_create_manager' (451a475e-4ad8-43c5-8c05-8a7eedec0c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbdc42f-80c7-41d9-b5f7-712e6fe657ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbdc42f-80c7-41d9-b5f7-712e6fe657ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-294717807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc03392b-2dc4-4f98-a8de-822502c99ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b145ba26b984495ad22772c481ebf11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:40Z,use_quota=True,user_id='e8a67b2dbc1b49fbab37ea2c722256eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd9bf94-9a32-4ec4-bead-9966074e4b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd9bf94-9a32-4ec4-bead-9966074e4b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4c3d55-1773-437c-bb6d-44d0be2111d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4c3d55-1773-437c-bb6d-44d0be2111d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc03392b-2dc4-4f98-a8de-822502c99ee6', 'volume_name': 'volume-bc03392b-2dc4-4f98-a8de-822502c99ee6', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2f5252-eab9-49df-afec-f674db7705c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2f5252-eab9-49df-afec-f674db7705c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c91fb8-bf62-4f7e-8a50-99c9aa2b1e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:40 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Volume bc03392b-2dc4-4f98-a8de-822502c99ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc03392b-2dc4-4f98-a8de-822502c99ee6', 'volume_size': 1} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-294717807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc03392b-2dc4-4f98-a8de-822502c99ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b145ba26b984495ad22772c481ebf11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:40Z,use_quota=True,user_id='e8a67b2dbc1b49fbab37ea2c722256eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Creating volume bc03392b-2dc4-4f98-a8de-822502c99ee6 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:40 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bc03392b-2dc4-4f98-a8de-822502c99ee6 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:40 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bc03392b-2dc4-4f98-a8de-822502c99ee6 1073741824 Sep 19 00:01:40 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Flow 'volume_create_manager' (074fe253-d94c-412c-bd10-63a58d3d0cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6907d7-bab5-48d1-bf2d-25b320b8dfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6907d7-bab5-48d1-bf2d-25b320b8dfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-960455230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb85f657-feb1-4548-86e0-833a673ccf09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b145ba26b984495ad22772c481ebf11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:41Z,use_quota=True,user_id='e8a67b2dbc1b49fbab37ea2c722256eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6aae288-9412-41c3-a6b3-6a9fa2d91c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6aae288-9412-41c3-a6b3-6a9fa2d91c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:41 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307fc2af-8492-4b50-92a5-acdf343b0b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307fc2af-8492-4b50-92a5-acdf343b0b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb85f657-feb1-4548-86e0-833a673ccf09', 'volume_name': 'volume-fb85f657-feb1-4548-86e0-833a673ccf09', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760cbfc0-2fb8-4b40-9664-5b515a78fdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760cbfc0-2fb8-4b40-9664-5b515a78fdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc03eb81-c9ec-4697-b2fb-56b0f2630486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:41 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Volume fb85f657-feb1-4548-86e0-833a673ccf09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb85f657-feb1-4548-86e0-833a673ccf09', 'volume_size': 1} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bc03392b-2dc4-4f98-a8de-822502c99ee6 1073741824" returned: 0 in 0.776s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bc03392b-2dc4-4f98-a8de-822502c99ee6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:41 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bc03392b-2dc4-4f98-a8de-822502c99ee6 Sep 19 00:01:41 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:41 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bc03392b-2dc4-4f98-a8de-822502c99ee6" returned: 0 in 0.466s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-960455230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb85f657-feb1-4548-86e0-833a673ccf09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b145ba26b984495ad22772c481ebf11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:41Z,use_quota=True,user_id='e8a67b2dbc1b49fbab37ea2c722256eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Creating volume fb85f657-feb1-4548-86e0-833a673ccf09 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:41 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fb85f657-feb1-4548-86e0-833a673ccf09 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:41 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fb85f657-feb1-4548-86e0-833a673ccf09 1073741824 Sep 19 00:01:41 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Flow 'volume_create_manager' (d0035f9f-76d1-4d0a-99eb-20c682b8d307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3571746-6be9-4193-96e3-9831df32c1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c91fb8-bf62-4f7e-8a50-99c9aa2b1e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc03392b-2dc4-4f98-a8de-822502c99ee6', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98faef7-ed9b-4a10-a1c8-0a38ce6c5c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:41 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Volume volume-bc03392b-2dc4-4f98-a8de-822502c99ee6 (bc03392b-2dc4-4f98-a8de-822502c99ee6): created successfully Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98faef7-ed9b-4a10-a1c8-0a38ce6c5c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Flow 'volume_create_manager' (451a475e-4ad8-43c5-8c05-8a7eedec0c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3571746-6be9-4193-96e3-9831df32c1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-561599382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a36180-18a5-49f4-bed8-d1dfa477ee1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b145ba26b984495ad22772c481ebf11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:42Z,use_quota=True,user_id='e8a67b2dbc1b49fbab37ea2c722256eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8272fd8a-769d-4b21-956a-d57ee9e8542d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8272fd8a-769d-4b21-956a-d57ee9e8542d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277a3f4e-8d11-4ab0-8822-a90e25063ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277a3f4e-8d11-4ab0-8822-a90e25063ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a36180-18a5-49f4-bed8-d1dfa477ee1f', 'volume_name': 'volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb5db42-9bed-41d6-8528-ae6d99ee654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb5db42-9bed-41d6-8528-ae6d99ee654a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351d8200-8073-4ad2-adbf-f768c2e467c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:41 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Volume 30a36180-18a5-49f4-bed8-d1dfa477ee1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f', 'volume_size': 1} Sep 19 00:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9af59dbd-1ab6-4738-a5b8-c68ffdb61f93 tempest-CreateVolumesFromImageTest-1088822074 None] Created volume successfully. Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Flow 'volume_create_manager' (7bc92ab2-6ec2-40c8-b763-4e878ff38f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f9f6e5-9824-4980-933b-f9249963e14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f9f6e5-9824-4980-933b-f9249963e14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7804b4c-54e2-41ee-8c67-6407cd331602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3f0b50947240608d6d5f49898efe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:42Z,use_quota=True,user_id='8bfc797ca90148598e59d79dc4336637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528f5461-2942-4934-8b23-9b4d54c1f11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528f5461-2942-4934-8b23-9b4d54c1f11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e437a3-08aa-4697-8a9c-819d007cc605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e437a3-08aa-4697-8a9c-819d007cc605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7804b4c-54e2-41ee-8c67-6407cd331602', 'volume_name': 'volume-d7804b4c-54e2-41ee-8c67-6407cd331602', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b5d32f-c9ce-4fdc-b16e-02164a5aeecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b5d32f-c9ce-4fdc-b16e-02164a5aeecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808d0c15-4afe-49ba-8e1a-cc1b4073855c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:42 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Volume d7804b4c-54e2-41ee-8c67-6407cd331602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7804b4c-54e2-41ee-8c67-6407cd331602', 'volume_size': 1} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Flow 'volume_create_manager' (f933abe5-76fa-4c33-ac76-8dd105a6797c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9386ef41-e5f2-4656-a3c7-2c86c9aba29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9386ef41-e5f2-4656-a3c7-2c86c9aba29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1048161487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ffcee1-44f5-40f8-98e4-d474ab1df84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b145ba26b984495ad22772c481ebf11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:42Z,use_quota=True,user_id='e8a67b2dbc1b49fbab37ea2c722256eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af843977-d388-4a34-8ba7-f31e55a66b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af843977-d388-4a34-8ba7-f31e55a66b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2b7658-92fd-45a6-915a-93bc80e45ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2b7658-92fd-45a6-915a-93bc80e45ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ffcee1-44f5-40f8-98e4-d474ab1df84f', 'volume_name': 'volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cf3fc6-6535-4fcb-b3c6-c1aa636fe751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cf3fc6-6535-4fcb-b3c6-c1aa636fe751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967388b4-9cf7-455f-ab0c-6bd76e4f877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:42 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Volume 92ffcee1-44f5-40f8-98e4-d474ab1df84f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f', 'volume_size': 1} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:42 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fb85f657-feb1-4548-86e0-833a673ccf09 1073741824" returned: 0 in 0.774s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fb85f657-feb1-4548-86e0-833a673ccf09 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:42 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fb85f657-feb1-4548-86e0-833a673ccf09 Sep 19 00:01:42 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:42 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fb85f657-feb1-4548-86e0-833a673ccf09" returned: 0 in 0.411s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-561599382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a36180-18a5-49f4-bed8-d1dfa477ee1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b145ba26b984495ad22772c481ebf11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:42Z,use_quota=True,user_id='e8a67b2dbc1b49fbab37ea2c722256eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Creating volume 30a36180-18a5-49f4-bed8-d1dfa477ee1f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:42 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:42 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f 1073741824 Sep 19 00:01:42 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Flow 'volume_create_manager' (5de93841-3209-46f4-8279-7a8adba2ebc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4da0f1-fcd6-48f4-a12e-e1e7d1990a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc03eb81-c9ec-4697-b2fb-56b0f2630486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb85f657-feb1-4548-86e0-833a673ccf09', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a35e00-5066-48fc-94b2-2a9761bb569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4da0f1-fcd6-48f4-a12e-e1e7d1990a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-63503675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c05c696-af34-4868-8bd4-959b6af3b489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b145ba26b984495ad22772c481ebf11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:43Z,use_quota=True,user_id='e8a67b2dbc1b49fbab37ea2c722256eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62a3354-54b7-44dc-9891-5cb0bdb7bf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62a3354-54b7-44dc-9891-5cb0bdb7bf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593d19fb-3496-44da-9b90-24bacf129972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593d19fb-3496-44da-9b90-24bacf129972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c05c696-af34-4868-8bd4-959b6af3b489', 'volume_name': 'volume-0c05c696-af34-4868-8bd4-959b6af3b489', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee11f2c-f2c4-4b4c-abbf-55a427c92d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee11f2c-f2c4-4b4c-abbf-55a427c92d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19135782-5f8f-4ef3-9989-0eaad6d4260a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Volume 0c05c696-af34-4868-8bd4-959b6af3b489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c05c696-af34-4868-8bd4-959b6af3b489', 'volume_size': 1} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Volume volume-fb85f657-feb1-4548-86e0-833a673ccf09 (fb85f657-feb1-4548-86e0-833a673ccf09): created successfully Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a35e00-5066-48fc-94b2-2a9761bb569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Flow 'volume_create_manager' (074fe253-d94c-412c-bd10-63a58d3d0cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f6f2e1fb-7ff4-4b16-b851-17b2bd608753 tempest-CreateVolumesFromImageTest-1088822074 None] Created volume successfully. Sep 19 00:01:43 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f 1073741824" returned: 0 in 0.483s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:43 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f Sep 19 00:01:43 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:43 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f" returned: 0 in 0.279s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7804b4c-54e2-41ee-8c67-6407cd331602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3f0b50947240608d6d5f49898efe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:42Z,use_quota=True,user_id='8bfc797ca90148598e59d79dc4336637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Creating volume d7804b4c-54e2-41ee-8c67-6407cd331602 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:43 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7804b4c-54e2-41ee-8c67-6407cd331602 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:43 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7804b4c-54e2-41ee-8c67-6407cd331602 1073741824 Sep 19 00:01:43 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351d8200-8073-4ad2-adbf-f768c2e467c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14d2efc-f18d-4a09-9a69-42e7bdd7cd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Volume volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f (30a36180-18a5-49f4-bed8-d1dfa477ee1f): created successfully Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14d2efc-f18d-4a09-9a69-42e7bdd7cd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Flow 'volume_create_manager' (d0035f9f-76d1-4d0a-99eb-20c682b8d307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a4181e63-f167-4a54-ae33-945deeba6fda tempest-CreateVolumesFromImageTest-1088822074 None] Created volume successfully. Sep 19 00:01:44 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7804b4c-54e2-41ee-8c67-6407cd331602 1073741824" returned: 0 in 0.499s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7804b4c-54e2-41ee-8c67-6407cd331602 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:44 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7804b4c-54e2-41ee-8c67-6407cd331602 Sep 19 00:01:44 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:44 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7804b4c-54e2-41ee-8c67-6407cd331602" returned: 0 in 0.272s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.133s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1048161487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ffcee1-44f5-40f8-98e4-d474ab1df84f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b145ba26b984495ad22772c481ebf11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:42Z,use_quota=True,user_id='e8a67b2dbc1b49fbab37ea2c722256eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Creating volume 92ffcee1-44f5-40f8-98e4-d474ab1df84f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:44 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:44 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f 1073741824 Sep 19 00:01:44 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808d0c15-4afe-49ba-8e1a-cc1b4073855c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7804b4c-54e2-41ee-8c67-6407cd331602', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe0584ab-6cb7-4b2c-b88e-e84b7b203a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:44 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Volume volume-d7804b4c-54e2-41ee-8c67-6407cd331602 (d7804b4c-54e2-41ee-8c67-6407cd331602): created successfully Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe0584ab-6cb7-4b2c-b88e-e84b7b203a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Flow 'volume_create_manager' (7bc92ab2-6ec2-40c8-b763-4e878ff38f7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-33b5f3e7-2129-4f22-8717-92b784ec49e5 tempest-CinderUnicodeTest-1396892977 None] Created volume successfully. Sep 19 00:01:45 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f 1073741824" returned: 0 in 0.463s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:45 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f Sep 19 00:01:45 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:45 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f" returned: 0 in 0.310s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.320s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-63503675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c05c696-af34-4868-8bd4-959b6af3b489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b145ba26b984495ad22772c481ebf11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:43Z,use_quota=True,user_id='e8a67b2dbc1b49fbab37ea2c722256eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Creating volume 0c05c696-af34-4868-8bd4-959b6af3b489 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:45 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c05c696-af34-4868-8bd4-959b6af3b489 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:45 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c05c696-af34-4868-8bd4-959b6af3b489 1073741824 Sep 19 00:01:45 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967388b4-9cf7-455f-ab0c-6bd76e4f877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c04f4b6-8260-4bb0-b72d-c4cb40a77b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Flow 'volume_create_manager' (5fe35436-49f6-4822-b780-4c9d46a42b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943815b7-b97f-4853-b1e6-8f53c65b228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:45 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Volume volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f (92ffcee1-44f5-40f8-98e4-d474ab1df84f): created successfully Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c04f4b6-8260-4bb0-b72d-c4cb40a77b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Flow 'volume_create_manager' (f933abe5-76fa-4c33-ac76-8dd105a6797c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943815b7-b97f-4853-b1e6-8f53c65b228d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1054960609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a664e8e2-afb0-4cf0-bbae-d97f9b11b556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3f0b50947240608d6d5f49898efe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:45Z,use_quota=True,user_id='8bfc797ca90148598e59d79dc4336637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffecef66-71b3-4ff4-83df-9d67a123a36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffecef66-71b3-4ff4-83df-9d67a123a36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac02a71-3f65-4103-8f84-ccf4d0142b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac02a71-3f65-4103-8f84-ccf4d0142b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a664e8e2-afb0-4cf0-bbae-d97f9b11b556', 'volume_name': 'volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6443ce68-7689-4645-b02e-a54205ffcc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6443ce68-7689-4645-b02e-a54205ffcc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa294093-f43c-444b-b162-8e9b4784f391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:45 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Volume a664e8e2-afb0-4cf0-bbae-d97f9b11b556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556', 'volume_size': 1} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3aa0811d-873a-4aea-9415-6d60ea6fb568 tempest-CreateVolumesFromImageTest-1088822074 None] Created volume successfully. Sep 19 00:01:45 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c05c696-af34-4868-8bd4-959b6af3b489 1073741824" returned: 0 in 0.423s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c05c696-af34-4868-8bd4-959b6af3b489 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:45 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c05c696-af34-4868-8bd4-959b6af3b489 Sep 19 00:01:45 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:46 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c05c696-af34-4868-8bd4-959b6af3b489" returned: 0 in 0.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1054960609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a664e8e2-afb0-4cf0-bbae-d97f9b11b556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3f0b50947240608d6d5f49898efe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:45Z,use_quota=True,user_id='8bfc797ca90148598e59d79dc4336637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Creating volume a664e8e2-afb0-4cf0-bbae-d97f9b11b556 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:46 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19135782-5f8f-4ef3-9989-0eaad6d4260a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c05c696-af34-4868-8bd4-959b6af3b489', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155a3974-a97b-46f9-bc5b-1c4f5ae34fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:46 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 1073741824 Sep 19 00:01:46 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:46 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Volume volume-0c05c696-af34-4868-8bd4-959b6af3b489 (0c05c696-af34-4868-8bd4-959b6af3b489): created successfully Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155a3974-a97b-46f9-bc5b-1c4f5ae34fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Flow 'volume_create_manager' (5de93841-3209-46f4-8279-7a8adba2ebc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f2ce04bd-fd49-4dca-b31a-7e22988c001e tempest-CreateVolumesFromImageTest-1088822074 None] Created volume successfully. Sep 19 00:01:46 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 1073741824" returned: 0 in 0.443s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:46 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 Sep 19 00:01:46 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:46 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556" returned: 0 in 0.252s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa294093-f43c-444b-b162-8e9b4784f391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f091fc79-759d-4cbb-8fac-d7b4149b2358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:46 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Volume volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 (a664e8e2-afb0-4cf0-bbae-d97f9b11b556): created successfully Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f091fc79-759d-4cbb-8fac-d7b4149b2358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Flow 'volume_create_manager' (5fe35436-49f6-4822-b780-4c9d46a42b7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-829c0587-481a-4b00-874f-217a5c82c745 tempest-CinderUnicodeTest-1396892977 None] Created volume successfully. Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "cinder-0c05c696-af34-4868-8bd4-959b6af3b489-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-0c05c696-af34-4868-8bd4-959b6af3b489-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "cinder-quobyte-0c05c696-af34-4868-8bd4-959b6af3b489" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-quobyte-0c05c696-af34-4868-8bd4-959b6af3b489" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8252f8-5623-421f-94a1-2afe6e318caa]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c05c696-af34-4868-8bd4-959b6af3b489 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:47 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c05c696-af34-4868-8bd4-959b6af3b489 Sep 19 00:01:47 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=164,cinder:SELECT=113,cinder:DELETE=13,cinder:INSERT=36 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] Creating offline snapshot 09491a04-d0b2-41cf-8a90-fc456ef21b78 of volume a664e8e2-afb0-4cf0-bbae-d97f9b11b556 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4b75ac-b0a6-4432-a193-5e937d634cad]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:47 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c05c696-af34-4868-8bd4-959b6af3b489" returned: 0 in 0.423s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c05c696-af34-4868-8bd4-959b6af3b489 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:47 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c05c696-af34-4868-8bd4-959b6af3b489 Sep 19 00:01:47 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:48 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 Sep 19 00:01:48 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:48 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0c05c696-af34-4868-8bd4-959b6af3b489" returned: 0 in 0.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-quobyte-0c05c696-af34-4868-8bd4-959b6af3b489" released by "delete_volume" :: held 0.730s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Created reservations ['b30116ab-6193-4e52-8262-8d8d8c65abc6', 'f023272d-463e-492d-90bc-e925e269137c', '9a2e798d-5e4a-4bf1-b66f-1dc8a2094261', 'a29d43a2-fe10-4e77-8469-c4ee5d064d05'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:48 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556" returned: 0 in 0.441s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:48 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 1G Sep 19 00:01:48 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:48 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:48 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "cinder-92ffcee1-44f5-40f8-98e4-d474ab1df84f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-92ffcee1-44f5-40f8-98e4-d474ab1df84f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "cinder-quobyte-92ffcee1-44f5-40f8-98e4-d474ab1df84f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-quobyte-92ffcee1-44f5-40f8-98e4-d474ab1df84f" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bff07e-c0e4-4957-8840-9343e13a0f86]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:48 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.423s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Deleted volume successfully. Sep 19 00:01:48 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-50fa4430-1307-4a6c-b81b-22291deb9ebe tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-0c05c696-af34-4868-8bd4-959b6af3b489-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 1G" returned: 0 in 0.550s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:48 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f Sep 19 00:01:48 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:48 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 Sep 19 00:01:48 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:49 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f" returned: 0 in 0.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:49 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f Sep 19 00:01:49 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:49 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78" returned: 0 in 0.355s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:49 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 is being set with open permissions: ugo+rw Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:49 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 Sep 19 00:01:49 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:49 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-92ffcee1-44f5-40f8-98e4-d474ab1df84f" returned: 0 in 0.274s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-quobyte-92ffcee1-44f5-40f8-98e4-d474ab1df84f" released by "delete_volume" :: held 0.739s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Created reservations ['2630354a-55ec-4bcc-ae72-81b6e0062e3b', '5f520b34-5d31-4b72-8312-ef2401df7096', 'a59591ce-a518-4ffb-80bc-387c26b95c3c', 'c7bdcaec-bbf0-4baf-96c0-0adb5f76814b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:49 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78" returned: 0 in 0.272s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:49 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.info Sep 19 00:01:49 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:49 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:49 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:49 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "cinder-30a36180-18a5-49f4-bed8-d1dfa477ee1f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.info" returned: 0 in 0.317s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:49 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.info is being set with open permissions: ugo+rw Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-30a36180-18a5-49f4-bed8-d1dfa477ee1f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:49 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.info Sep 19 00:01:49 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "cinder-quobyte-30a36180-18a5-49f4-bed8-d1dfa477ee1f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:50 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-quobyte-30a36180-18a5-49f4-bed8-d1dfa477ee1f" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.392s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:50 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Deleted volume successfully. Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[237bfd80-5f93-4068-8718-ee695bef4069]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b1d15eff-1a0e-494a-971f-ca2aa2aac0b2 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-92ffcee1-44f5-40f8-98e4-d474ab1df84f-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:50 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f Sep 19 00:01:50 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:50 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.info" returned: 0 in 0.321s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.376s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:50 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7d05a525-ad15-49cb-bbf8-9d26bb90f4e2 tempest-CinderUnicodeTest-1396892977 None] Create snapshot completed successfully Sep 19 00:01:50 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f" returned: 0 in 0.395s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:50 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f Sep 19 00:01:50 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:50 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-30a36180-18a5-49f4-bed8-d1dfa477ee1f" returned: 0 in 0.259s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-quobyte-30a36180-18a5-49f4-bed8-d1dfa477ee1f" released by "delete_volume" :: held 0.712s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Created reservations ['d5bff7bc-5ea6-4424-ae15-6fb19fbc2379', '992850b2-d426-4272-9145-4fe63d495271', '9d711f48-9003-4f90-9d88-534488c0f33f', 'a4b42614-9a8b-492e-b85c-4a4b59b99116'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:50 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:50 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "cinder-09491a04-d0b2-41cf-8a90-fc456ef21b78-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "cinder-fb85f657-feb1-4548-86e0-833a673ccf09-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-09491a04-d0b2-41cf-8a90-fc456ef21b78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "cinder-quobyte-a664e8e2-afb0-4cf0-bbae-d97f9b11b556" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:51 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Deleted volume successfully. Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-fb85f657-feb1-4548-86e0-833a673ccf09-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-quobyte-a664e8e2-afb0-4cf0-bbae-d97f9b11b556" acquired by "delete_snapshot" :: waited 0.052s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "cinder-quobyte-09491a04-d0b2-41cf-8a90-fc456ef21b78" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-06d1e689-d842-4a03-9b9c-ba6782718f84 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-30a36180-18a5-49f4-bed8-d1dfa477ee1f-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-quobyte-09491a04-d0b2-41cf-8a90-fc456ef21b78" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Deleting offline snapshot 09491a04-d0b2-41cf-8a90-fc456ef21b78 of volume a664e8e2-afb0-4cf0-bbae-d97f9b11b556 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] snapshot_file for this snap is: volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "cinder-quobyte-fb85f657-feb1-4548-86e0-833a673ccf09" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e452adac-4837-415a-b717-471deb3e9773]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-quobyte-fb85f657-feb1-4548-86e0-833a673ccf09" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2104d082-1e58-45b7-be6f-86016d2c8382]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fb85f657-feb1-4548-86e0-833a673ccf09 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:51 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 Sep 19 00:01:51 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:51 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fb85f657-feb1-4548-86e0-833a673ccf09 Sep 19 00:01:51 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:51 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78" returned: 0 in 0.419s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f2ed20-3a03-4db7-a8a6-536d388dcb92]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:51 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fb85f657-feb1-4548-86e0-833a673ccf09" returned: 0 in 0.427s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fb85f657-feb1-4548-86e0-833a673ccf09 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:51 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fb85f657-feb1-4548-86e0-833a673ccf09 Sep 19 00:01:51 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:51 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 Sep 19 00:01:51 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:52 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fb85f657-feb1-4548-86e0-833a673ccf09" returned: 0 in 0.320s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-quobyte-fb85f657-feb1-4548-86e0-833a673ccf09" released by "delete_volume" :: held 0.817s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Created reservations ['72b08997-2927-4863-9edb-bf225677380e', '8e40e6f5-7895-415e-9fd4-48ffb4721275', 'f1ef63dc-27e2-4f7c-afbc-595b4d1a11e2', '33fe7320-3754-4c6a-887e-ec54a1964e65'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:52 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556" returned: 0 in 0.497s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:52 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 Sep 19 00:01:52 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "cinder-bc03392b-2dc4-4f98-a8de-822502c99ee6-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:52 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:52 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-bc03392b-2dc4-4f98-a8de-822502c99ee6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "cinder-quobyte-bc03392b-2dc4-4f98-a8de-822502c99ee6" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-quobyte-bc03392b-2dc4-4f98-a8de-822502c99ee6" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82680af-c5ec-4dde-8cc1-eb7e60c7e0ef]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bc03392b-2dc4-4f98-a8de-822502c99ee6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:52 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.369s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Deleted volume successfully. Sep 19 00:01:52 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bc03392b-2dc4-4f98-a8de-822502c99ee6 Sep 19 00:01:52 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0847c014-6dd4-4d97-997b-c0d5d8c9b52d tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-fb85f657-feb1-4548-86e0-833a673ccf09-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:52 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78" returned: 0 in 0.508s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:52 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78 Sep 19 00:01:52 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:52 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bc03392b-2dc4-4f98-a8de-822502c99ee6" returned: 0 in 0.441s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bc03392b-2dc4-4f98-a8de-822502c99ee6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:53 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bc03392b-2dc4-4f98-a8de-822502c99ee6 Sep 19 00:01:53 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:53 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556.09491a04-d0b2-41cf-8a90-fc456ef21b78" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-quobyte-09491a04-d0b2-41cf-8a90-fc456ef21b78" released by "_delete_snapshot" :: held 1.838s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-quobyte-a664e8e2-afb0-4cf0-bbae-d97f9b11b556" released by "delete_snapshot" :: held 1.896s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Created reservations ['6ca733db-5d95-46a0-ab80-51e3e6859263', '2d7ac71a-e216-4d7e-969f-e904c9421388', 'e0014f2b-0c7c-46cd-8d57-218b87b9c59c', '47df8846-eba3-42ea-b1d9-03367322327b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Delete snapshot completed successfully. Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-28655021-db2d-4173-80fa-bd653d1fbb5f tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-09491a04-d0b2-41cf-8a90-fc456ef21b78-delete_snapshot" released by "delete_snapshot" :: held 2.108s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:53 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bc03392b-2dc4-4f98-a8de-822502c99ee6" returned: 0 in 0.298s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-quobyte-bc03392b-2dc4-4f98-a8de-822502c99ee6" released by "delete_volume" :: held 0.799s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Created reservations ['706d063e-e4fe-497c-ba3a-01dde18f8e74', '0b63dd5e-6148-40df-999b-6493342d8f8b', 'd6f7f608-7c1d-4253-8703-3695c283dfa3', '7276aa21-df5d-48fa-9905-f820cc28d4c3'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "cinder-a664e8e2-afb0-4cf0-bbae-d97f9b11b556-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=171,cinder:UPDATE=180,cinder:INSERT=54,cinder:DELETE=17 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-a664e8e2-afb0-4cf0-bbae-d97f9b11b556-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "cinder-quobyte-a664e8e2-afb0-4cf0-bbae-d97f9b11b556" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-quobyte-a664e8e2-afb0-4cf0-bbae-d97f9b11b556" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e2ad0c-df94-4bbd-a8e6-4cd330a238f3]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:53 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:53 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:53 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 Sep 19 00:01:53 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:53 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.300s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Deleted volume successfully. Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-515e5bb2-840e-4b4b-903a-3d2a247aa671 tempest-CreateVolumesFromImageTest-1088822074 None] Lock "cinder-bc03392b-2dc4-4f98-a8de-822502c99ee6-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:53 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556" returned: 0 in 0.453s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:54 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556 Sep 19 00:01:54 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:54 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a664e8e2-afb0-4cf0-bbae-d97f9b11b556" returned: 0 in 0.297s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-quobyte-a664e8e2-afb0-4cf0-bbae-d97f9b11b556" released by "delete_volume" :: held 0.832s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Created reservations ['d79fef82-8513-4b4b-9718-c8d796b4f399', '182a9d37-7107-4ad3-8073-4ba367768d05', 'ceb8ebc5-dcff-4b83-9ca4-c1f4078bc5b6', 'bac1b243-7d67-44fd-af53-5cda3564cd93'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:54 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:54 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "cinder-d7804b4c-54e2-41ee-8c67-6407cd331602-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-d7804b4c-54e2-41ee-8c67-6407cd331602-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "cinder-quobyte-d7804b4c-54e2-41ee-8c67-6407cd331602" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-quobyte-d7804b4c-54e2-41ee-8c67-6407cd331602" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[237633db-0b21-4773-a2fb-c3507938f7c0]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7804b4c-54e2-41ee-8c67-6407cd331602 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:54 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.398s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:54 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Deleted volume successfully. Sep 19 00:01:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8114cd0e-ee0b-42d0-a70c-094b6cdc83c0 tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-a664e8e2-afb0-4cf0-bbae-d97f9b11b556-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:54 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7804b4c-54e2-41ee-8c67-6407cd331602 Sep 19 00:01:54 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:55 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7804b4c-54e2-41ee-8c67-6407cd331602" returned: 0 in 0.417s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7804b4c-54e2-41ee-8c67-6407cd331602 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:55 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7804b4c-54e2-41ee-8c67-6407cd331602 Sep 19 00:01:55 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:55 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d7804b4c-54e2-41ee-8c67-6407cd331602" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-quobyte-d7804b4c-54e2-41ee-8c67-6407cd331602" released by "delete_volume" :: held 0.744s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Created reservations ['1ee4a862-8054-4eac-b471-5b9d2297f78a', '6d3a0a82-9c35-48ad-a6c1-9bf72131dce5', '124e21fe-7279-4877-90c5-60ef866d8318', '2b0167a0-d08a-4797-b92d-b7c362639d4b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:55 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:01:55 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:55 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.262s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:01:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Deleted volume successfully. Sep 19 00:01:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-12da75ae-7ccd-46a8-8e68-f25cb4000806 tempest-CinderUnicodeTest-1396892977 None] Lock "cinder-d7804b4c-54e2-41ee-8c67-6407cd331602-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:01:56 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Flow 'volume_create_manager' (7a9b9c9f-f10f-4f01-9747-e156410c7862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb8b211-5224-409b-99c9-bcf4adf65da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb8b211-5224-409b-99c9-bcf4adf65da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1494688501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9696b69d-0345-43de-9ead-0987658d6b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116c8c51690e4a95a981c4772d934488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:57Z,use_quota=True,user_id='2caec97eec6349858eb015811198b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f09022a-a918-4b6b-83c0-708b44f8daff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f09022a-a918-4b6b-83c0-708b44f8daff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eec4b01-e0c1-4fa6-b6fd-2914a3b5c867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eec4b01-e0c1-4fa6-b6fd-2914a3b5c867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9696b69d-0345-43de-9ead-0987658d6b98', 'volume_name': 'volume-9696b69d-0345-43de-9ead-0987658d6b98', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2563cd7e-974f-431d-b9e3-c5909aa9627c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2563cd7e-974f-431d-b9e3-c5909aa9627c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b75066-75c7-4c66-bdc1-b6c4150571fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:57 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume 9696b69d-0345-43de-9ead-0987658d6b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9696b69d-0345-43de-9ead-0987658d6b98', 'volume_size': 1} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1494688501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9696b69d-0345-43de-9ead-0987658d6b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116c8c51690e4a95a981c4772d934488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:01:57Z,use_quota=True,user_id='2caec97eec6349858eb015811198b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Creating volume 9696b69d-0345-43de-9ead-0987658d6b98 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:57 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9696b69d-0345-43de-9ead-0987658d6b98 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:57 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9696b69d-0345-43de-9ead-0987658d6b98 1073741824 Sep 19 00:01:57 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:57 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9696b69d-0345-43de-9ead-0987658d6b98 1073741824" returned: 0 in 0.454s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9696b69d-0345-43de-9ead-0987658d6b98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:57 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9696b69d-0345-43de-9ead-0987658d6b98 Sep 19 00:01:57 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:01:57 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9696b69d-0345-43de-9ead-0987658d6b98" returned: 0 in 0.292s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b75066-75c7-4c66-bdc1-b6c4150571fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9696b69d-0345-43de-9ead-0987658d6b98', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d58eaa-5a95-4464-9186-dbcc3e17cd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:57 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume volume-9696b69d-0345-43de-9ead-0987658d6b98 (9696b69d-0345-43de-9ead-0987658d6b98): created successfully Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d58eaa-5a95-4464-9186-dbcc3e17cd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Flow 'volume_create_manager' (7a9b9c9f-f10f-4f01-9747-e156410c7862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9894e169-edf1-4fad-b216-52fbf893eddd tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Created volume successfully. Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Flow 'volume_create_manager' (285c2d79-6b33-44f9-837f-e0bcc3817b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35680e7-fa32-4e5b-858b-41cf88ac76ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35680e7-fa32-4e5b-858b-41cf88ac76ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1245461262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f92a449-d3c8-459e-aa9a-4971aa00d647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116c8c51690e4a95a981c4772d934488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:00Z,use_quota=True,user_id='2caec97eec6349858eb015811198b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2e39dc-2c6b-4882-9798-2efb73225ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2e39dc-2c6b-4882-9798-2efb73225ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3a12d6-d244-4223-849e-df93c6e7d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3a12d6-d244-4223-849e-df93c6e7d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f92a449-d3c8-459e-aa9a-4971aa00d647', 'volume_name': 'volume-8f92a449-d3c8-459e-aa9a-4971aa00d647', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851c95e9-b59a-4b85-8699-b248b3e87b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851c95e9-b59a-4b85-8699-b248b3e87b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5810418-2bde-4ad0-95c6-e2e3cbff978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:01:59 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume 8f92a449-d3c8-459e-aa9a-4971aa00d647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f92a449-d3c8-459e-aa9a-4971aa00d647', 'volume_size': 1} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1245461262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f92a449-d3c8-459e-aa9a-4971aa00d647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116c8c51690e4a95a981c4772d934488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:00Z,use_quota=True,user_id='2caec97eec6349858eb015811198b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Creating volume 8f92a449-d3c8-459e-aa9a-4971aa00d647 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:01:59 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:01:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8f92a449-d3c8-459e-aa9a-4971aa00d647 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:01:59 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8f92a449-d3c8-459e-aa9a-4971aa00d647 1073741824 Sep 19 00:01:59 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Flow 'volume_create_manager' (92848274-99e5-4aa0-bddc-d2cf36d0c089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc103d1-bddb-44dc-89f2-fc0332901965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc103d1-bddb-44dc-89f2-fc0332901965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-470060789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b94a057-5c81-4c8a-ab2a-59c2926833ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116c8c51690e4a95a981c4772d934488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:00Z,use_quota=True,user_id='2caec97eec6349858eb015811198b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36af7b3c-4a17-49e6-ba2c-1384b899c326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36af7b3c-4a17-49e6-ba2c-1384b899c326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf070de-4fd7-4f5d-a1a9-167d24090e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf070de-4fd7-4f5d-a1a9-167d24090e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b94a057-5c81-4c8a-ab2a-59c2926833ad', 'volume_name': 'volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089c2588-6aa8-463a-a64a-f2a99457a40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089c2588-6aa8-463a-a64a-f2a99457a40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad32eb64-a04c-4a1a-881a-6e31b4030f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume 1b94a057-5c81-4c8a-ab2a-59c2926833ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad', 'volume_size': 1} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:00 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8f92a449-d3c8-459e-aa9a-4971aa00d647 1073741824" returned: 0 in 0.647s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8f92a449-d3c8-459e-aa9a-4971aa00d647 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:00 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8f92a449-d3c8-459e-aa9a-4971aa00d647 Sep 19 00:02:00 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Flow 'volume_create_manager' (68a53b93-3084-4111-a2bd-1fe20f40138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b6538e-b86e-4c85-b3f8-e3d33aa2cef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b6538e-b86e-4c85-b3f8-e3d33aa2cef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922990444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc51540-3f09-488e-805c-31cac0ba5e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116c8c51690e4a95a981c4772d934488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:00Z,use_quota=True,user_id='2caec97eec6349858eb015811198b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d859548-49bc-474c-b226-bd06407e5c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d859548-49bc-474c-b226-bd06407e5c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af8f69f-4de3-49f1-809f-3737740a62ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af8f69f-4de3-49f1-809f-3737740a62ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dc51540-3f09-488e-805c-31cac0ba5e27', 'volume_name': 'volume-0dc51540-3f09-488e-805c-31cac0ba5e27', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720539ec-6cf7-4da4-b20b-f5aca08937e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720539ec-6cf7-4da4-b20b-f5aca08937e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dac4d9c-f03f-4580-9854-865fcb74c35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume 0dc51540-3f09-488e-805c-31cac0ba5e27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dc51540-3f09-488e-805c-31cac0ba5e27', 'volume_size': 1} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:00 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8f92a449-d3c8-459e-aa9a-4971aa00d647" returned: 0 in 0.351s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-470060789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b94a057-5c81-4c8a-ab2a-59c2926833ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116c8c51690e4a95a981c4772d934488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:00Z,use_quota=True,user_id='2caec97eec6349858eb015811198b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Creating volume 1b94a057-5c81-4c8a-ab2a-59c2926833ad {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:00 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5810418-2bde-4ad0-95c6-e2e3cbff978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f92a449-d3c8-459e-aa9a-4971aa00d647', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:00 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad 1073741824 Sep 19 00:02:00 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cac4f4a-e148-4b84-8295-c1623daa5c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume volume-8f92a449-d3c8-459e-aa9a-4971aa00d647 (8f92a449-d3c8-459e-aa9a-4971aa00d647): created successfully Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cac4f4a-e148-4b84-8295-c1623daa5c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Flow 'volume_create_manager' (285c2d79-6b33-44f9-837f-e0bcc3817b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Flow 'volume_create_manager' (9801f099-d6ff-4f4a-a174-2af77957b780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6b819a-6c05-4e75-b5bb-551aca66eae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6c73b767-2572-418a-ab91-7272a1b1ef88 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Created volume successfully. Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6b819a-6c05-4e75-b5bb-551aca66eae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1623043724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f945446c-c9b0-4ae8-ae4f-8470fc17a2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116c8c51690e4a95a981c4772d934488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:01Z,use_quota=True,user_id='2caec97eec6349858eb015811198b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bf250e-cfa4-4279-9adb-5d64ec09220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bf250e-cfa4-4279-9adb-5d64ec09220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab1843e-e6a8-4fae-a998-8cd771dc4679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab1843e-e6a8-4fae-a998-8cd771dc4679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f945446c-c9b0-4ae8-ae4f-8470fc17a2f5', 'volume_name': 'volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5adacb7-3d3c-4572-96f8-3eb99044335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5adacb7-3d3c-4572-96f8-3eb99044335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b284ba03-c14e-4266-abec-6173e023924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:01 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume f945446c-c9b0-4ae8-ae4f-8470fc17a2f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5', 'volume_size': 1} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Flow 'volume_create_manager' (eac10802-01c8-4792-a910-04df4dfdf5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:01 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a28efb0-712b-4b76-8fe9-d2b7b8b53298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad 1073741824" returned: 0 in 0.593s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a28efb0-712b-4b76-8fe9-d2b7b8b53298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-137644424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e5aa16-f536-4f65-9c85-374d62e78ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116c8c51690e4a95a981c4772d934488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:01Z,use_quota=True,user_id='2caec97eec6349858eb015811198b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebe2bb4-50f0-49e8-ba85-6165bc598617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebe2bb4-50f0-49e8-ba85-6165bc598617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e472133e-cbee-4647-94a0-1fcee45e51dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e472133e-cbee-4647-94a0-1fcee45e51dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e5aa16-f536-4f65-9c85-374d62e78ba0', 'volume_name': 'volume-48e5aa16-f536-4f65-9c85-374d62e78ba0', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31900da9-8ca3-476c-a73e-b4e18d768092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31900da9-8ca3-476c-a73e-b4e18d768092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7e00fc-339f-41d7-b0c6-0e8f119a836a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:01 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume 48e5aa16-f536-4f65-9c85-374d62e78ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e5aa16-f536-4f65-9c85-374d62e78ba0', 'volume_size': 1} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:01 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad Sep 19 00:02:01 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:01 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad" returned: 0 in 0.248s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.157s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922990444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc51540-3f09-488e-805c-31cac0ba5e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116c8c51690e4a95a981c4772d934488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:00Z,use_quota=True,user_id='2caec97eec6349858eb015811198b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Creating volume 0dc51540-3f09-488e-805c-31cac0ba5e27 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:01 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0dc51540-3f09-488e-805c-31cac0ba5e27 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad32eb64-a04c-4a1a-881a-6e31b4030f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4629b495-4523-4797-8e11-9e1e4a0a1980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:01 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0dc51540-3f09-488e-805c-31cac0ba5e27 1073741824 Sep 19 00:02:01 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:01 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad (1b94a057-5c81-4c8a-ab2a-59c2926833ad): created successfully Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4629b495-4523-4797-8e11-9e1e4a0a1980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Flow 'volume_create_manager' (92848274-99e5-4aa0-bddc-d2cf36d0c089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-36754802-5d67-49b7-939c-a298edc50e86 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Created volume successfully. Sep 19 00:02:02 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0dc51540-3f09-488e-805c-31cac0ba5e27 1073741824" returned: 0 in 0.558s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0dc51540-3f09-488e-805c-31cac0ba5e27 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:02 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0dc51540-3f09-488e-805c-31cac0ba5e27 Sep 19 00:02:02 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:02 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0dc51540-3f09-488e-805c-31cac0ba5e27" returned: 0 in 0.300s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.627s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1623043724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f945446c-c9b0-4ae8-ae4f-8470fc17a2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116c8c51690e4a95a981c4772d934488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:01Z,use_quota=True,user_id='2caec97eec6349858eb015811198b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Creating volume f945446c-c9b0-4ae8-ae4f-8470fc17a2f5 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:02 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dac4d9c-f03f-4580-9854-865fcb74c35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dc51540-3f09-488e-805c-31cac0ba5e27', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:02 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5 1073741824 Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26595e2e-7c49-4a17-8450-e77c3ba0cb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:02 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume volume-0dc51540-3f09-488e-805c-31cac0ba5e27 (0dc51540-3f09-488e-805c-31cac0ba5e27): created successfully Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26595e2e-7c49-4a17-8450-e77c3ba0cb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Flow 'volume_create_manager' (68a53b93-3084-4111-a2bd-1fe20f40138e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c12f0a2e-f592-4702-9a3b-7ab68e44d950 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Created volume successfully. Sep 19 00:02:03 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5 1073741824" returned: 0 in 0.500s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:03 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5 Sep 19 00:02:03 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:03 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5" returned: 0 in 0.252s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.024s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-137644424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e5aa16-f536-4f65-9c85-374d62e78ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116c8c51690e4a95a981c4772d934488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:01Z,use_quota=True,user_id='2caec97eec6349858eb015811198b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Creating volume 48e5aa16-f536-4f65-9c85-374d62e78ba0 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:03 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48e5aa16-f536-4f65-9c85-374d62e78ba0 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:03 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48e5aa16-f536-4f65-9c85-374d62e78ba0 1073741824 Sep 19 00:02:03 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b284ba03-c14e-4266-abec-6173e023924c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb28d3d-05b7-4b38-bb1c-32bfad66108b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5 (f945446c-c9b0-4ae8-ae4f-8470fc17a2f5): created successfully Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb28d3d-05b7-4b38-bb1c-32bfad66108b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Flow 'volume_create_manager' (9801f099-d6ff-4f4a-a174-2af77957b780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9c53c6ee-f8c4-4db0-8e89-e413196443af tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Created volume successfully. Sep 19 00:02:03 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48e5aa16-f536-4f65-9c85-374d62e78ba0 1073741824" returned: 0 in 0.435s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48e5aa16-f536-4f65-9c85-374d62e78ba0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:03 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48e5aa16-f536-4f65-9c85-374d62e78ba0 Sep 19 00:02:03 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:04 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48e5aa16-f536-4f65-9c85-374d62e78ba0" returned: 0 in 0.249s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7e00fc-339f-41d7-b0c6-0e8f119a836a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e5aa16-f536-4f65-9c85-374d62e78ba0', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca7e60d-6c22-40f4-a70d-861f801ad355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:04 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Volume volume-48e5aa16-f536-4f65-9c85-374d62e78ba0 (48e5aa16-f536-4f65-9c85-374d62e78ba0): created successfully Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca7e60d-6c22-40f4-a70d-861f801ad355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Flow 'volume_create_manager' (eac10802-01c8-4792-a910-04df4dfdf5a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ad8462ab-f6a4-4a10-b9d5-1f14906f3e50 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Created volume successfully. Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "cinder-48e5aa16-f536-4f65-9c85-374d62e78ba0-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-48e5aa16-f536-4f65-9c85-374d62e78ba0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "cinder-quobyte-48e5aa16-f536-4f65-9c85-374d62e78ba0" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-quobyte-48e5aa16-f536-4f65-9c85-374d62e78ba0" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[af637462-47cb-4426-846f-58fe2874cf2d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48e5aa16-f536-4f65-9c85-374d62e78ba0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:05 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48e5aa16-f536-4f65-9c85-374d62e78ba0 Sep 19 00:02:05 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:05 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48e5aa16-f536-4f65-9c85-374d62e78ba0" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48e5aa16-f536-4f65-9c85-374d62e78ba0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:05 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48e5aa16-f536-4f65-9c85-374d62e78ba0 Sep 19 00:02:05 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:05 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-48e5aa16-f536-4f65-9c85-374d62e78ba0" returned: 0 in 0.251s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-quobyte-48e5aa16-f536-4f65-9c85-374d62e78ba0" released by "delete_volume" :: held 0.646s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Created reservations ['9dd643ee-824e-45e1-b866-eb681aec6460', '4358387c-aa86-42bb-8786-d097cacb8428', 'b568fd7e-fd5b-4fff-b02e-2174b5449524', '7bb3af19-ae7a-40b8-a6e1-5e966f022f20'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:05 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:05 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:05 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.239s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Deleted volume successfully. Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0314cf05-147a-42f8-824e-12c445c10a79 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-48e5aa16-f536-4f65-9c85-374d62e78ba0-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "cinder-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "cinder-quobyte-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-quobyte-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[30742d95-c577-476b-8c69-3444aaceddb7]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:06 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5 Sep 19 00:02:06 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:06 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5" returned: 0 in 0.371s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:06 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5 Sep 19 00:02:06 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:06 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-quobyte-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5" released by "delete_volume" :: held 0.652s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Created reservations ['c6ee6b0a-63bb-4134-bc6e-a8e8e4a3dd90', '8cf3ff91-5eb4-4f22-9f71-6a3a4df74cf3', '6cd8d1ac-3dc6-4d6f-8ca5-495861d1895f', '394fd439-aa4a-48d3-aa85-be5c479e01d2'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:06 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:06 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:07 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.242s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Deleted volume successfully. Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b49ba732-98fc-41f9-be8d-c546224dffdf tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-f945446c-c9b0-4ae8-ae4f-8470fc17a2f5-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "cinder-0dc51540-3f09-488e-805c-31cac0ba5e27-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-0dc51540-3f09-488e-805c-31cac0ba5e27-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "cinder-quobyte-0dc51540-3f09-488e-805c-31cac0ba5e27" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-quobyte-0dc51540-3f09-488e-805c-31cac0ba5e27" acquired by "delete_volume" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6109347-e8c2-48ee-ac5d-c8cdcae37347]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0dc51540-3f09-488e-805c-31cac0ba5e27 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:07 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0dc51540-3f09-488e-805c-31cac0ba5e27 Sep 19 00:02:07 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:07 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0dc51540-3f09-488e-805c-31cac0ba5e27" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0dc51540-3f09-488e-805c-31cac0ba5e27 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:07 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0dc51540-3f09-488e-805c-31cac0ba5e27 Sep 19 00:02:07 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:07 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0dc51540-3f09-488e-805c-31cac0ba5e27" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-quobyte-0dc51540-3f09-488e-805c-31cac0ba5e27" released by "delete_volume" :: held 0.639s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Created reservations ['05e5fdad-1d41-43ea-9256-6c8ac84462a4', 'b9fba976-c979-4f07-8776-a897883f2c0b', '06fe3175-e67b-41fc-a2d2-e401c359b02a', 'abfeafa1-fbaa-45e1-aeb7-ef26b49e6563'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:07 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:07 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:08 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.268s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Deleted volume successfully. Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9f475ee8-ed35-4185-ba00-5a58d5512aa1 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-0dc51540-3f09-488e-805c-31cac0ba5e27-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "cinder-1b94a057-5c81-4c8a-ab2a-59c2926833ad-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-1b94a057-5c81-4c8a-ab2a-59c2926833ad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "cinder-quobyte-1b94a057-5c81-4c8a-ab2a-59c2926833ad" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-quobyte-1b94a057-5c81-4c8a-ab2a-59c2926833ad" acquired by "delete_volume" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a26c89-2ac8-46d8-8e2d-c94f3c4cb4fa]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:08 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad Sep 19 00:02:08 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:08 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:08 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad Sep 19 00:02:08 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:08 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1b94a057-5c81-4c8a-ab2a-59c2926833ad" returned: 0 in 0.239s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-quobyte-1b94a057-5c81-4c8a-ab2a-59c2926833ad" released by "delete_volume" :: held 0.636s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Created reservations ['5978f206-5fc5-44f4-bdf2-6d57fb31f007', 'a1d07c55-3e36-45d6-a061-8da53c225bc3', 'dbf0a172-3a52-445a-bc60-bd09e8d96f6b', '181853ea-04d7-4890-a64c-6bfab9a63dd4'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:09 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:09 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:09 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Deleted volume successfully. Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a94e1703-dcb2-4247-8a78-4b3a70d1e4d4 tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-1b94a057-5c81-4c8a-ab2a-59c2926833ad-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "cinder-8f92a449-d3c8-459e-aa9a-4971aa00d647-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-8f92a449-d3c8-459e-aa9a-4971aa00d647-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "cinder-quobyte-8f92a449-d3c8-459e-aa9a-4971aa00d647" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-quobyte-8f92a449-d3c8-459e-aa9a-4971aa00d647" acquired by "delete_volume" :: waited 0.013s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6875ea8-f90a-44d8-bbde-6bce70aea726]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8f92a449-d3c8-459e-aa9a-4971aa00d647 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:09 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8f92a449-d3c8-459e-aa9a-4971aa00d647 Sep 19 00:02:09 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:09 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8f92a449-d3c8-459e-aa9a-4971aa00d647" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8f92a449-d3c8-459e-aa9a-4971aa00d647 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:09 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8f92a449-d3c8-459e-aa9a-4971aa00d647 Sep 19 00:02:09 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:10 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8f92a449-d3c8-459e-aa9a-4971aa00d647" returned: 0 in 0.242s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-quobyte-8f92a449-d3c8-459e-aa9a-4971aa00d647" released by "delete_volume" :: held 0.639s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Created reservations ['99581a12-7d49-4fd8-8b00-76ad964341b2', 'c7f56678-d3de-470e-bc25-33816bc90d74', 'd0d40e87-a767-4c2f-8d14-f67f6100b833', '89ba832a-c804-4eb2-8f0c-92cff9415c52'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:10 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:10 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:10 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.245s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Deleted volume successfully. Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3b86eba0-7166-4cf8-9a18-ccb06207f35a tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-8f92a449-d3c8-459e-aa9a-4971aa00d647-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "cinder-9696b69d-0345-43de-9ead-0987658d6b98-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-9696b69d-0345-43de-9ead-0987658d6b98-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "cinder-quobyte-9696b69d-0345-43de-9ead-0987658d6b98" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-quobyte-9696b69d-0345-43de-9ead-0987658d6b98" acquired by "delete_volume" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab512d0b-7c7f-4429-9a40-439f2151ab6c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9696b69d-0345-43de-9ead-0987658d6b98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:10 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9696b69d-0345-43de-9ead-0987658d6b98 Sep 19 00:02:10 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:11 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9696b69d-0345-43de-9ead-0987658d6b98" returned: 0 in 0.349s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9696b69d-0345-43de-9ead-0987658d6b98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:11 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9696b69d-0345-43de-9ead-0987658d6b98 Sep 19 00:02:11 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:11 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9696b69d-0345-43de-9ead-0987658d6b98" returned: 0 in 0.251s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-quobyte-9696b69d-0345-43de-9ead-0987658d6b98" released by "delete_volume" :: held 0.644s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Created reservations ['a862dc80-12e3-4571-ae81-31c2b8c9624b', '3dc71a8a-88ba-4e71-9154-ae582a304de4', 'ac7c24b6-7c4d-40c6-ab6f-a05b163fa308', 'aeebfc7e-69f0-48ec-a979-2d79662aedbf'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:11 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:11 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:11 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.240s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Deleted volume successfully. Sep 19 00:02:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9be490f8-0941-4197-a040-f9141c1430ad tempest-CreateVolumesFromSourceVolumeTest-318537501 None] Lock "cinder-9696b69d-0345-43de-9ead-0987658d6b98-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:14 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Flow 'volume_create_manager' (d34fb030-4c06-46c7-98bd-b155d8100ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ce1dc1-2e1f-4a13-9ebc-738e01f72bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ce1dc1-2e1f-4a13-9ebc-738e01f72bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1740806152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53de7541-72f6-4f12-b6c8-8bf60632287d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f62a5d32de4648a1e2a330f8653126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:15Z,use_quota=True,user_id='906b90516b094627bce5b555f1a4ec20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908c191e-9602-4e14-af5f-930656c3abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908c191e-9602-4e14-af5f-930656c3abe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86844f1a-6774-48bf-aab2-dcc4007e0a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86844f1a-6774-48bf-aab2-dcc4007e0a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53de7541-72f6-4f12-b6c8-8bf60632287d', 'volume_name': 'volume-53de7541-72f6-4f12-b6c8-8bf60632287d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181f300c-318f-4ec8-9cd9-8c2c61a764af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181f300c-318f-4ec8-9cd9-8c2c61a764af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f693d42-6ebf-4354-9b74-f34c0573211d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:15 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Volume 53de7541-72f6-4f12-b6c8-8bf60632287d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53de7541-72f6-4f12-b6c8-8bf60632287d', 'volume_size': 1} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1740806152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53de7541-72f6-4f12-b6c8-8bf60632287d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f62a5d32de4648a1e2a330f8653126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:15Z,use_quota=True,user_id='906b90516b094627bce5b555f1a4ec20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Creating volume 53de7541-72f6-4f12-b6c8-8bf60632287d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:15 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53de7541-72f6-4f12-b6c8-8bf60632287d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:15 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53de7541-72f6-4f12-b6c8-8bf60632287d 1073741824 Sep 19 00:02:15 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:15 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53de7541-72f6-4f12-b6c8-8bf60632287d 1073741824" returned: 0 in 0.404s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53de7541-72f6-4f12-b6c8-8bf60632287d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:15 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53de7541-72f6-4f12-b6c8-8bf60632287d Sep 19 00:02:15 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:15 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53de7541-72f6-4f12-b6c8-8bf60632287d" returned: 0 in 0.236s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f693d42-6ebf-4354-9b74-f34c0573211d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53de7541-72f6-4f12-b6c8-8bf60632287d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43d04e6-daae-4d37-8d17-1e58cad582fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:15 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Volume volume-53de7541-72f6-4f12-b6c8-8bf60632287d (53de7541-72f6-4f12-b6c8-8bf60632287d): created successfully Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43d04e6-daae-4d37-8d17-1e58cad582fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Flow 'volume_create_manager' (d34fb030-4c06-46c7-98bd-b155d8100ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d882ccb0-9a36-408b-8a46-0b6501a4a0a5 tempest-ProjectReaderTests-2146968883 None] Created volume successfully. Sep 19 00:02:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Acquiring lock "cinder-53de7541-72f6-4f12-b6c8-8bf60632287d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Lock "cinder-53de7541-72f6-4f12-b6c8-8bf60632287d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Acquiring lock "cinder-quobyte-53de7541-72f6-4f12-b6c8-8bf60632287d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Lock "cinder-quobyte-53de7541-72f6-4f12-b6c8-8bf60632287d" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56fee26-62cd-4679-bd4d-7ae897997cd3]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53de7541-72f6-4f12-b6c8-8bf60632287d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:16 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53de7541-72f6-4f12-b6c8-8bf60632287d Sep 19 00:02:16 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:16 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53de7541-72f6-4f12-b6c8-8bf60632287d" returned: 0 in 0.440s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53de7541-72f6-4f12-b6c8-8bf60632287d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:16 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53de7541-72f6-4f12-b6c8-8bf60632287d Sep 19 00:02:16 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:17 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-53de7541-72f6-4f12-b6c8-8bf60632287d" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Lock "cinder-quobyte-53de7541-72f6-4f12-b6c8-8bf60632287d" released by "delete_volume" :: held 0.845s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Created reservations ['eaf93628-57f5-44c4-9f33-a5c4cf042786', 'fc9b40be-fc6b-4894-9c79-2b99aae48103', 'e88212b3-000a-4cb2-a20a-9169bbc63386', 'c74e140d-1970-43c7-8952-b1046cb5967f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:17 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:17 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:17 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.444s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:17 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Deleted volume successfully. Sep 19 00:02:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4a7f28ac-6078-419b-8224-da208b7681e1 tempest-ProjectReaderTests-2146968883 None] Lock "cinder-53de7541-72f6-4f12-b6c8-8bf60632287d-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Flow 'volume_create_manager' (4399767f-98d9-4e94-b17b-bfa75cf2ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce31c866-8288-49d8-8c28-922d39049dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce31c866-8288-49d8-8c28-922d39049dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10222940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a2cae9-5336-4eb3-9de3-40e4f1099cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f62a5d32de4648a1e2a330f8653126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:18Z,use_quota=True,user_id='906b90516b094627bce5b555f1a4ec20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5a327b-9d10-497c-ade3-2e93abd50115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5a327b-9d10-497c-ade3-2e93abd50115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d2a92d-be46-4afa-a7a9-96de0ec23298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d2a92d-be46-4afa-a7a9-96de0ec23298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a2cae9-5336-4eb3-9de3-40e4f1099cdc', 'volume_name': 'volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13453cf-1c09-4bd0-976f-d8bc31f73ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13453cf-1c09-4bd0-976f-d8bc31f73ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fb0f20-8d6b-49bf-bcea-3f87b9427c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:18 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Volume 87a2cae9-5336-4eb3-9de3-40e4f1099cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc', 'volume_size': 1} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10222940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a2cae9-5336-4eb3-9de3-40e4f1099cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f62a5d32de4648a1e2a330f8653126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:18Z,use_quota=True,user_id='906b90516b094627bce5b555f1a4ec20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Creating volume 87a2cae9-5336-4eb3-9de3-40e4f1099cdc {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:18 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:18 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc 1073741824 Sep 19 00:02:18 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:18 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc 1073741824" returned: 0 in 0.523s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:19 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc Sep 19 00:02:19 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-b7871bc0-9019-4276-af58-c18631217e7e tempest-TestShelveInstance-1954266482 None] Terminate volume connection completed successfully. Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-b7871bc0-9019-4276-af58-c18631217e7e tempest-TestShelveInstance-1954266482 None] Deleting attachment fb247cc5-7795-4758-b436-71bcbeac185e. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 19 00:02:19 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc" returned: 0 in 0.317s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fb0f20-8d6b-49bf-bcea-3f87b9427c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccfe4b1b-ac1c-497d-a6d8-c2fe07976022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Volume volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc (87a2cae9-5336-4eb3-9de3-40e4f1099cdc): created successfully Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccfe4b1b-ac1c-497d-a6d8-c2fe07976022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Flow 'volume_create_manager' (4399767f-98d9-4e94-b17b-bfa75cf2ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-747e8024-e242-4554-855e-07c1203860f1 tempest-ProjectReaderTests-2146968883 None] Created volume successfully. Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Acquiring lock "cinder-26203521-cbc1-41ec-adf2-17b111dc1a72-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Lock "cinder-26203521-cbc1-41ec-adf2-17b111dc1a72-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Acquiring lock "cinder-quobyte-26203521-cbc1-41ec-adf2-17b111dc1a72" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Lock "cinder-quobyte-26203521-cbc1-41ec-adf2-17b111dc1a72" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5963ee2-cd24-4c49-b145-92982464079d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:19 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 Sep 19 00:02:19 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:19 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72" returned: 0 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:19 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72 Sep 19 00:02:19 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:20 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Acquiring lock "cinder-87a2cae9-5336-4eb3-9de3-40e4f1099cdc-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-26203521-cbc1-41ec-adf2-17b111dc1a72" returned: 0 in 0.260s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Lock "cinder-quobyte-26203521-cbc1-41ec-adf2-17b111dc1a72" released by "delete_volume" :: held 0.682s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Lock "cinder-87a2cae9-5336-4eb3-9de3-40e4f1099cdc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Acquiring lock "cinder-quobyte-87a2cae9-5336-4eb3-9de3-40e4f1099cdc" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Lock "cinder-quobyte-87a2cae9-5336-4eb3-9de3-40e4f1099cdc" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG cinder.quota [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Created reservations ['2e9d38f0-832e-4d66-b4b0-13c7c4e4ff4c', 'fcf00c98-6ae3-46a9-9d90-1ba33dd38f0d', 'd2d50e7b-30c3-4748-8afd-30686856e073', 'a1d7a5a3-c508-4d37-8b65-f7cf11e6a13b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0660ac9-e12e-4509-9446-4682b1e1845d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:20 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc Sep 19 00:02:20 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:20 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:20 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:20 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.277s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG cinder.manager [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Deleted volume successfully. Sep 19 00:02:20 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-24b49b11-7761-4e1c-9a85-bab3292b5db8 req-fadfbe68-0b5b-4ebe-a914-407b41f8f00d tempest-TestShelveInstance-1954266482 None] Lock "cinder-26203521-cbc1-41ec-adf2-17b111dc1a72-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc" returned: 0 in 0.423s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:20 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc Sep 19 00:02:20 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:20 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-87a2cae9-5336-4eb3-9de3-40e4f1099cdc" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Lock "cinder-quobyte-87a2cae9-5336-4eb3-9de3-40e4f1099cdc" released by "delete_volume" :: held 0.740s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Created reservations ['1fdb5480-c0d1-474b-ba85-dba0484070dc', '52ca9188-00a8-4afa-b669-f9217eb95d84', '8a7f801b-495a-4580-a5e2-a8852216488d', '6c509481-5a61-4b53-955d-1d536c841ea9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:21 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:21 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:21 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:21 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:21 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.300s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Deleted volume successfully. Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-40ecf000-a76d-4c0b-97dc-c0e7fbb15fd3 tempest-ProjectReaderTests-2146968883 None] Lock "cinder-87a2cae9-5336-4eb3-9de3-40e4f1099cdc-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:21 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.314s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 29 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 19 00:02:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Flow 'volume_create_manager' (41bf9d08-5d8f-4f6d-8a44-b1007ac7d13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a22fc7e-1c47-4c27-8445-56d57749b630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a22fc7e-1c47-4c27-8445-56d57749b630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1562846751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20030834-4a2e-4d71-b132-3c993d50d699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f36a02eca14237b3bf69cb27bc8cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:25Z,use_quota=True,user_id='0a3831b09d374722a1c592af8aed5604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebe2094-aceb-48e3-86e2-3d72542ffb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebe2094-aceb-48e3-86e2-3d72542ffb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a039b308-17b0-43af-84b7-db0992cc9bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a039b308-17b0-43af-84b7-db0992cc9bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20030834-4a2e-4d71-b132-3c993d50d699', 'volume_name': 'volume-20030834-4a2e-4d71-b132-3c993d50d699', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1384c2fd-1ee0-435f-92ac-d8a2bf02bda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1384c2fd-1ee0-435f-92ac-d8a2bf02bda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4c3e4b-9ce0-4e80-9ad0-f50da1b63e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Volume 20030834-4a2e-4d71-b132-3c993d50d699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20030834-4a2e-4d71-b132-3c993d50d699', 'volume_size': 1} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1562846751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20030834-4a2e-4d71-b132-3c993d50d699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f36a02eca14237b3bf69cb27bc8cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:25Z,use_quota=True,user_id='0a3831b09d374722a1c592af8aed5604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Creating volume 20030834-4a2e-4d71-b132-3c993d50d699 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:25 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-20030834-4a2e-4d71-b132-3c993d50d699 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:25 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-20030834-4a2e-4d71-b132-3c993d50d699 1073741824 Sep 19 00:02:25 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:25 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-20030834-4a2e-4d71-b132-3c993d50d699 1073741824" returned: 0 in 0.505s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-20030834-4a2e-4d71-b132-3c993d50d699 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:25 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-20030834-4a2e-4d71-b132-3c993d50d699 Sep 19 00:02:25 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:26 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-20030834-4a2e-4d71-b132-3c993d50d699" returned: 0 in 0.262s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4c3e4b-9ce0-4e80-9ad0-f50da1b63e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20030834-4a2e-4d71-b132-3c993d50d699', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63edd6c-41b2-41c5-ad3c-1033d9fec834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Volume volume-20030834-4a2e-4d71-b132-3c993d50d699 (20030834-4a2e-4d71-b132-3c993d50d699): created successfully Sep 19 00:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63edd6c-41b2-41c5-ad3c-1033d9fec834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Flow 'volume_create_manager' (41bf9d08-5d8f-4f6d-8a44-b1007ac7d13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cbad6378-15be-4466-859c-38c9f68e6099 tempest-ProjectReaderTests-58567943 None] Created volume successfully. Sep 19 00:02:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Acquiring lock "cinder-20030834-4a2e-4d71-b132-3c993d50d699-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Lock "cinder-20030834-4a2e-4d71-b132-3c993d50d699-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Acquiring lock "cinder-quobyte-20030834-4a2e-4d71-b132-3c993d50d699" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Lock "cinder-quobyte-20030834-4a2e-4d71-b132-3c993d50d699" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[453a5847-e54b-40c4-8cc5-8f32e4205e11]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-20030834-4a2e-4d71-b132-3c993d50d699 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:27 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-20030834-4a2e-4d71-b132-3c993d50d699 Sep 19 00:02:27 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:27 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-20030834-4a2e-4d71-b132-3c993d50d699" returned: 0 in 0.390s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-20030834-4a2e-4d71-b132-3c993d50d699 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:27 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-20030834-4a2e-4d71-b132-3c993d50d699 Sep 19 00:02:27 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:28 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-20030834-4a2e-4d71-b132-3c993d50d699" returned: 0 in 0.257s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Lock "cinder-quobyte-20030834-4a2e-4d71-b132-3c993d50d699" released by "delete_volume" :: held 0.686s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:28 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Created reservations ['a11e1a52-2544-403a-808b-2cea66680352', '6bdb3067-11ee-4a1d-9ad9-bfd9d814981c', 'f87398b6-a368-43b2-94e3-874fa8f20849', '921197c8-999e-4f32-b980-fe4b57babdd9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:28 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:28 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:28 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.275s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:28 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Deleted volume successfully. Sep 19 00:02:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-85272000-cf9d-48cd-9b27-0462a579c476 tempest-ProjectReaderTests-58567943 None] Lock "cinder-20030834-4a2e-4d71-b132-3c993d50d699-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Flow 'volume_create_manager' (87e722c1-ff8e-4cd0-97bc-ff655f1b66ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373afdbe-2fb4-49f0-a6e3-fbbb61d5ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373afdbe-2fb4-49f0-a6e3-fbbb61d5ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-422950748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb41b2c7-497b-439a-b86f-6f7b361cd270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f36a02eca14237b3bf69cb27bc8cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:29Z,use_quota=True,user_id='0a3831b09d374722a1c592af8aed5604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450c24a3-0cfc-4a54-9618-e75bbbbf65a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450c24a3-0cfc-4a54-9618-e75bbbbf65a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734e4955-5861-4e77-ac29-328b7ca02eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734e4955-5861-4e77-ac29-328b7ca02eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb41b2c7-497b-439a-b86f-6f7b361cd270', 'volume_name': 'volume-bb41b2c7-497b-439a-b86f-6f7b361cd270', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3489c621-1e1f-42b1-8e85-e61ca58997c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3489c621-1e1f-42b1-8e85-e61ca58997c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27b6a57-a913-4e5f-bf63-863542de6c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Volume bb41b2c7-497b-439a-b86f-6f7b361cd270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb41b2c7-497b-439a-b86f-6f7b361cd270', 'volume_size': 1} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-422950748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb41b2c7-497b-439a-b86f-6f7b361cd270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f36a02eca14237b3bf69cb27bc8cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:29Z,use_quota=True,user_id='0a3831b09d374722a1c592af8aed5604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Creating volume bb41b2c7-497b-439a-b86f-6f7b361cd270 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:29 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb41b2c7-497b-439a-b86f-6f7b361cd270 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:29 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb41b2c7-497b-439a-b86f-6f7b361cd270 1073741824 Sep 19 00:02:29 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:29 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb41b2c7-497b-439a-b86f-6f7b361cd270 1073741824" returned: 0 in 0.477s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb41b2c7-497b-439a-b86f-6f7b361cd270 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:29 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb41b2c7-497b-439a-b86f-6f7b361cd270 Sep 19 00:02:29 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:29 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb41b2c7-497b-439a-b86f-6f7b361cd270" returned: 0 in 0.283s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27b6a57-a913-4e5f-bf63-863542de6c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb41b2c7-497b-439a-b86f-6f7b361cd270', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc23a6a-7ddd-4e0c-abdf-49f7aa5d19fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:30 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Volume volume-bb41b2c7-497b-439a-b86f-6f7b361cd270 (bb41b2c7-497b-439a-b86f-6f7b361cd270): created successfully Sep 19 00:02:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc23a6a-7ddd-4e0c-abdf-49f7aa5d19fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Flow 'volume_create_manager' (87e722c1-ff8e-4cd0-97bc-ff655f1b66ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5722ac65-6fcc-4557-b832-f0d04a5e779f tempest-ProjectReaderTests-58567943 None] Created volume successfully. Sep 19 00:02:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Acquiring lock "cinder-bb41b2c7-497b-439a-b86f-6f7b361cd270-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Lock "cinder-bb41b2c7-497b-439a-b86f-6f7b361cd270-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Acquiring lock "cinder-quobyte-bb41b2c7-497b-439a-b86f-6f7b361cd270" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Lock "cinder-quobyte-bb41b2c7-497b-439a-b86f-6f7b361cd270" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:31 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd288fe3-c287-4a5f-b17a-a2043688e80c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb41b2c7-497b-439a-b86f-6f7b361cd270 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:31 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb41b2c7-497b-439a-b86f-6f7b361cd270 Sep 19 00:02:31 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:31 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb41b2c7-497b-439a-b86f-6f7b361cd270" returned: 0 in 0.394s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb41b2c7-497b-439a-b86f-6f7b361cd270 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:31 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb41b2c7-497b-439a-b86f-6f7b361cd270 Sep 19 00:02:31 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:31 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb41b2c7-497b-439a-b86f-6f7b361cd270" returned: 0 in 0.260s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Lock "cinder-quobyte-bb41b2c7-497b-439a-b86f-6f7b361cd270" released by "delete_volume" :: held 0.702s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Created reservations ['004d1cdc-5148-4dd1-871c-ba88c4fe8ac6', '329cf4ef-596f-49bf-8979-a06bc9a2e43c', '7eaf04f7-19d3-4e52-be09-9ff5f2553e05', '66f88213-3be0-41ec-bf52-373f6b589ea2'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:32 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:32 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:32 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.260s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Deleted volume successfully. Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0f8bafc0-b9df-40f4-b962-2d9f31cdea10 tempest-ProjectReaderTests-58567943 None] Lock "cinder-bb41b2c7-497b-439a-b86f-6f7b361cd270-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Flow 'volume_create_manager' (acdeb1b3-67a6-4865-8191-3794681bdd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6372acf5-a10d-48bb-b7d3-f3993f832eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6372acf5-a10d-48bb-b7d3-f3993f832eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1751089400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16906af0-86ea-43c1-a60c-967ef0cf065c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f36a02eca14237b3bf69cb27bc8cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:33Z,use_quota=True,user_id='0a3831b09d374722a1c592af8aed5604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94397b9-7b8b-44b2-86c9-e34a0100ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94397b9-7b8b-44b2-86c9-e34a0100ef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de66f72f-2c63-4efb-a908-5888a13e93c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de66f72f-2c63-4efb-a908-5888a13e93c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16906af0-86ea-43c1-a60c-967ef0cf065c', 'volume_name': 'volume-16906af0-86ea-43c1-a60c-967ef0cf065c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf813a8-bb84-49b0-acd7-d40aa7bc7157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf813a8-bb84-49b0-acd7-d40aa7bc7157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa6fbf78-27cd-463c-9b6f-06faafcee937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:32 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Volume 16906af0-86ea-43c1-a60c-967ef0cf065c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16906af0-86ea-43c1-a60c-967ef0cf065c', 'volume_size': 1} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1751089400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16906af0-86ea-43c1-a60c-967ef0cf065c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f36a02eca14237b3bf69cb27bc8cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:33Z,use_quota=True,user_id='0a3831b09d374722a1c592af8aed5604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Creating volume 16906af0-86ea-43c1-a60c-967ef0cf065c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:32 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-16906af0-86ea-43c1-a60c-967ef0cf065c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:32 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-16906af0-86ea-43c1-a60c-967ef0cf065c 1073741824 Sep 19 00:02:32 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:33 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-16906af0-86ea-43c1-a60c-967ef0cf065c 1073741824" returned: 0 in 0.449s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-16906af0-86ea-43c1-a60c-967ef0cf065c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:33 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-16906af0-86ea-43c1-a60c-967ef0cf065c Sep 19 00:02:33 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:33 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-16906af0-86ea-43c1-a60c-967ef0cf065c" returned: 0 in 0.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa6fbf78-27cd-463c-9b6f-06faafcee937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16906af0-86ea-43c1-a60c-967ef0cf065c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe82dbff-8e19-4939-b587-ecf3fc2c2c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:33 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Volume volume-16906af0-86ea-43c1-a60c-967ef0cf065c (16906af0-86ea-43c1-a60c-967ef0cf065c): created successfully Sep 19 00:02:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe82dbff-8e19-4939-b587-ecf3fc2c2c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Flow 'volume_create_manager' (acdeb1b3-67a6-4865-8191-3794681bdd3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-68b34555-6814-4691-9b33-c349fdac5c3a tempest-ProjectReaderTests-58567943 None] Created volume successfully. Sep 19 00:02:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Acquiring lock "cinder-16906af0-86ea-43c1-a60c-967ef0cf065c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Lock "cinder-16906af0-86ea-43c1-a60c-967ef0cf065c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Acquiring lock "cinder-quobyte-16906af0-86ea-43c1-a60c-967ef0cf065c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Lock "cinder-quobyte-16906af0-86ea-43c1-a60c-967ef0cf065c" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e5f988-56de-48eb-a85d-53567c9e977b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-16906af0-86ea-43c1-a60c-967ef0cf065c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:34 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-16906af0-86ea-43c1-a60c-967ef0cf065c Sep 19 00:02:34 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:34 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-16906af0-86ea-43c1-a60c-967ef0cf065c" returned: 0 in 0.371s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-16906af0-86ea-43c1-a60c-967ef0cf065c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:34 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-16906af0-86ea-43c1-a60c-967ef0cf065c Sep 19 00:02:34 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:34 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-16906af0-86ea-43c1-a60c-967ef0cf065c" returned: 0 in 0.258s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Lock "cinder-quobyte-16906af0-86ea-43c1-a60c-967ef0cf065c" released by "delete_volume" :: held 0.687s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Created reservations ['d9e88d11-9a9b-4945-88b9-53ee60e50625', 'eac9c181-9699-4249-a302-d8290031fd74', '9524de8b-7e39-4160-98a9-f2a0a73f654d', '8a5976c4-bde9-4ab3-a16c-4e75e68dd05a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:34 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:34 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:35 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.252s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Deleted volume successfully. Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f6c17faf-d280-42f9-9166-e6aadeab8f40 tempest-ProjectReaderTests-58567943 None] Lock "cinder-16906af0-86ea-43c1-a60c-967ef0cf065c-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Flow 'volume_create_manager' (7f29edbf-64b4-4e17-9a7a-870231c6edec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9ad6de-e6f4-46d2-8ea4-6fa4985fe65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9ad6de-e6f4-46d2-8ea4-6fa4985fe65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13d0689f2644701913fa3c3321db960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:36Z,use_quota=True,user_id='e00ef1cf22ac4e288e516b3768c2f20a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9980db7e-1397-4b77-a99c-41a0daf759e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9980db7e-1397-4b77-a99c-41a0daf759e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76f3c8d-c1f4-40a7-9a55-1ca03be975a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Flow 'volume_create_manager' (5d06feb6-10b6-4652-b632-8adedcdf20eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e396bb-19e7-4836-8e1e-9eb8e38ffa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e396bb-19e7-4836-8e1e-9eb8e38ffa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798738685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e78be3-36b8-4268-97b7-fdab5a70fd84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f36a02eca14237b3bf69cb27bc8cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:36Z,use_quota=True,user_id='0a3831b09d374722a1c592af8aed5604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19bed7b7-608c-41eb-86d1-124269eaca96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19bed7b7-608c-41eb-86d1-124269eaca96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44370fd-fb93-4756-9305-2d9b1eb5d6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44370fd-fb93-4756-9305-2d9b1eb5d6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31e78be3-36b8-4268-97b7-fdab5a70fd84', 'volume_name': 'volume-31e78be3-36b8-4268-97b7-fdab5a70fd84', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f9d3b1-a0df-4634-a8a4-b8ad4a7af91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f9d3b1-a0df-4634-a8a4-b8ad4a7af91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1f8752-86d1-4a01-b58f-bb1d676cbcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Volume 31e78be3-36b8-4268-97b7-fdab5a70fd84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31e78be3-36b8-4268-97b7-fdab5a70fd84', 'volume_size': 1} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798738685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e78be3-36b8-4268-97b7-fdab5a70fd84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f36a02eca14237b3bf69cb27bc8cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:36Z,use_quota=True,user_id='0a3831b09d374722a1c592af8aed5604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Creating volume 31e78be3-36b8-4268-97b7-fdab5a70fd84 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:35 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-31e78be3-36b8-4268-97b7-fdab5a70fd84 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:35 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-31e78be3-36b8-4268-97b7-fdab5a70fd84 1073741824 Sep 19 00:02:35 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76f3c8d-c1f4-40a7-9a55-1ca03be975a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0', 'volume_name': 'volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0', 'volume_size': 1, 'image_id': 'f00ccf71-4846-4275-8c39-dc89b9934caa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f00ccf71-4846-4275-8c39-dc89b9934caa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbf890f1b07e641a5fe249eef86b6119', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a13d0689f2644701913fa3c3321db960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6544af3fc9940038d06d05725fa74d16cf7ccb7e2cb22991cfc33ce39164d65c748c9a94b6b8ec09c3792ebaa7db57ff7ac57590ac6556f7fc991f64ad9eae9e', 'id': 'f00ccf71-4846-4275-8c39-dc89b9934caa', 'created_at': datetime.datetime(2026, 9, 18, 22, 2, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 22, 2, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f00ccf71-4846-4275-8c39-dc89b9934caa/file', 'properties': {}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6f63d7-f38c-45b9-bff2-dae2b99b4167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6f63d7-f38c-45b9-bff2-dae2b99b4167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe811cf-e20c-4960-b426-f9e64a19b5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Volume 84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0', 'volume_size': 1, 'image_id': 'f00ccf71-4846-4275-8c39-dc89b9934caa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f00ccf71-4846-4275-8c39-dc89b9934caa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbf890f1b07e641a5fe249eef86b6119', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a13d0689f2644701913fa3c3321db960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6544af3fc9940038d06d05725fa74d16cf7ccb7e2cb22991cfc33ce39164d65c748c9a94b6b8ec09c3792ebaa7db57ff7ac57590ac6556f7fc991f64ad9eae9e', 'id': 'f00ccf71-4846-4275-8c39-dc89b9934caa', 'created_at': datetime.datetime(2026, 9, 18, 22, 2, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 22, 2, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f00ccf71-4846-4275-8c39-dc89b9934caa/file', 'properties': {}}, 'image_service': } Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Trying to clone 84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 from image f00ccf71-4846-4275-8c39-dc89b9934caa at location (None, [{'url': 'file:///opt/stack/data/glance/images/f00ccf71-4846-4275-8c39-dc89b9934caa', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 19 00:02:36 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Image download 0.00 MB at 0.00 MB/s Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cb001b-208e-4576-8e45-f8dfeb03d7a4]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:36 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD Sep 19 00:02:36 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:36 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-31e78be3-36b8-4268-97b7-fdab5a70fd84 1073741824" returned: 0 in 0.473s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-31e78be3-36b8-4268-97b7-fdab5a70fd84 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:36 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-31e78be3-36b8-4268-97b7-fdab5a70fd84 Sep 19 00:02:36 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:36 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:36 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD Sep 19 00:02:36 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:36 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-31e78be3-36b8-4268-97b7-fdab5a70fd84" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1f8752-86d1-4a01-b58f-bb1d676cbcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e78be3-36b8-4268-97b7-fdab5a70fd84', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4499cfc-8016-463f-ae0a-e33aab5b444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Volume volume-31e78be3-36b8-4268-97b7-fdab5a70fd84 (31e78be3-36b8-4268-97b7-fdab5a70fd84): created successfully Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4499cfc-8016-463f-ae0a-e33aab5b444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Flow 'volume_create_manager' (5d06feb6-10b6-4652-b632-8adedcdf20eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f533e7b5-6572-4bba-845a-bd264ff1d47e tempest-ProjectReaderTests-58567943 None] Created volume successfully. Sep 19 00:02:36 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Temporary image f00ccf71-4846-4275-8c39-dc89b9934caa is fetched for user e00ef1cf22ac4e288e516b3768c2f20a. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb70033-33b6-4e41-9599-0b5c86772968]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:37 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD Sep 19 00:02:37 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:37 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:37 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD Sep 19 00:02:37 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:37 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13d0689f2644701913fa3c3321db960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:36Z,use_quota=True,user_id='e00ef1cf22ac4e288e516b3768c2f20a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Creating volume 84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:37 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:37 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 1073741824 Sep 19 00:02:37 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Acquiring lock "cinder-31e78be3-36b8-4268-97b7-fdab5a70fd84-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Lock "cinder-31e78be3-36b8-4268-97b7-fdab5a70fd84-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:37 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 1073741824" returned: 0 in 0.413s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Acquiring lock "cinder-quobyte-31e78be3-36b8-4268-97b7-fdab5a70fd84" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Lock "cinder-quobyte-31e78be3-36b8-4268-97b7-fdab5a70fd84" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f719ac-a4a2-4229-9874-4301a20bd355]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-31e78be3-36b8-4268-97b7-fdab5a70fd84 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:38 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 Sep 19 00:02:38 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:38 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-31e78be3-36b8-4268-97b7-fdab5a70fd84 Sep 19 00:02:38 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:38 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0" returned: 0 in 0.257s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Attempting download of f00ccf71-4846-4275-8c39-dc89b9934caa ((None, [{'url': 'file:///opt/stack/data/glance/images/f00ccf71-4846-4275-8c39-dc89b9934caa', 'metadata': {}}])) to volume 84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9be6d7-cbba-4aee-97d9-0a5049d4314b]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f00ccf71-4846-4275-8c39-dc89b9934caa_zbe5ydey {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:38 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-31e78be3-36b8-4268-97b7-fdab5a70fd84" returned: 0 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-31e78be3-36b8-4268-97b7-fdab5a70fd84 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:38 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-31e78be3-36b8-4268-97b7-fdab5a70fd84 Sep 19 00:02:38 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:38 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f00ccf71-4846-4275-8c39-dc89b9934caa_zbe5ydey Sep 19 00:02:38 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:38 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:38 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-31e78be3-36b8-4268-97b7-fdab5a70fd84" returned: 0 in 0.262s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f00ccf71-4846-4275-8c39-dc89b9934caa_zbe5ydey" returned: 0 in 0.336s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f00ccf71-4846-4275-8c39-dc89b9934caa_zbe5ydey {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Lock "cinder-quobyte-31e78be3-36b8-4268-97b7-fdab5a70fd84" released by "delete_volume" :: held 0.696s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Created reservations ['95d45367-a1fa-4238-a634-7df229d95fe7', 'fcd3cc16-8591-4fec-8fcf-5ac62e4c43e4', '700abf3d-6f1d-4540-9a92-540f9c9506f4', '8d79332d-465b-4f10-bc45-600b7ef90484'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:38 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f00ccf71-4846-4275-8c39-dc89b9934caa_zbe5ydey Sep 19 00:02:38 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:38 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:38 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:39 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f00ccf71-4846-4275-8c39-dc89b9934caa_zbe5ydey" returned: 1 in 0.314s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f00ccf71-4846-4275-8c39-dc89b9934caa_zbe5ydey' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e28843c-980a-48c6-bae1-e56be58cb3b2]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:39 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Deleted volume successfully. Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b20dae-fb83-44fa-ae3e-bab948851c65 tempest-ProjectReaderTests-58567943 None] Lock "cinder-31e78be3-36b8-4268-97b7-fdab5a70fd84-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:39 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD Sep 19 00:02:39 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:39 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:39 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD Sep 19 00:02:39 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:39 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] f00ccf71-4846-4275-8c39-dc89b9934caa was raw, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 19 00:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:39 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 Sep 19 00:02:39 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:40 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0" returned: 0 in 0.484s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f00ccf71-4846-4275-8c39-dc89b9934caa_leik3idjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 19 00:02:40 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Converted 0.00 MB image at 0.00 MB/s Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:40 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 1G Sep 19 00:02:40 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:40 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 1G" returned: 0 in 0.341s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Downloaded image f00ccf71-4846-4275-8c39-dc89b9934caa ((None, [{'url': 'file:///opt/stack/data/glance/images/f00ccf71-4846-4275-8c39-dc89b9934caa', 'metadata': {}}])) to volume 84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Temporary image f00ccf71-4846-4275-8c39-dc89b9934caa for user e00ef1cf22ac4e288e516b3768c2f20a is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Marking volume 84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Copying metadata from image f00ccf71-4846-4275-8c39-dc89b9934caa to 84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Creating volume glance metadata for volume 84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 backed by image f00ccf71-4846-4275-8c39-dc89b9934caa with: {'image_id': 'f00ccf71-4846-4275-8c39-dc89b9934caa', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cbf890f1b07e641a5fe249eef86b6119', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe811cf-e20c-4960-b426-f9e64a19b5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0', 'volume_size': 1, 'image_id': 'f00ccf71-4846-4275-8c39-dc89b9934caa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f00ccf71-4846-4275-8c39-dc89b9934caa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbf890f1b07e641a5fe249eef86b6119', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a13d0689f2644701913fa3c3321db960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6544af3fc9940038d06d05725fa74d16cf7ccb7e2cb22991cfc33ce39164d65c748c9a94b6b8ec09c3792ebaa7db57ff7ac57590ac6556f7fc991f64ad9eae9e', 'id': 'f00ccf71-4846-4275-8c39-dc89b9934caa', 'created_at': datetime.datetime(2026, 9, 18, 22, 2, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 22, 2, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f00ccf71-4846-4275-8c39-dc89b9934caa/file', 'properties': {}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23bd9952-3f5e-4587-b83a-237b6624128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:40 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Volume volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 (84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0): created successfully Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23bd9952-3f5e-4587-b83a-237b6624128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Flow 'volume_create_manager' (7f29edbf-64b4-4e17-9a7a-870231c6edec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-022867cb-b8ee-4869-b0f4-6dbed61b340d tempest-VolumeImageDependencyTests-1704851419 None] Created volume successfully. Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Acquiring lock "cinder-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Lock "cinder-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Acquiring lock "cinder-quobyte-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Lock "cinder-quobyte-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[741bca1c-e67e-4701-ac45-ec91fd350099]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:41 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 Sep 19 00:02:41 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:41 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0" returned: 0 in 0.368s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:41 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0 Sep 19 00:02:41 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:41 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Lock "cinder-quobyte-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0" released by "delete_volume" :: held 0.651s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Created reservations ['64daea97-829b-4790-948a-b3a3b95eabcb', '8f7035da-7c77-4061-b82d-f04581fd0521', '6865d2c2-c51d-4f65-b7d3-09d4422fa666', '3189831b-b9e1-46b9-a9b8-dfe17f7b5610'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:41 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:02:41 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:41 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.231s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:02:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Deleted volume successfully. Sep 19 00:02:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d2ca7f9c-8180-48e9-ae59-8c9df1b050b4 tempest-VolumeImageDependencyTests-1704851419 None] Lock "cinder-84046ddd-c505-4ab9-b8a4-a3a2dc40f2b0-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:02:51 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=142,cinder:INSERT=60,cinder:UPDATE=215,cinder:DELETE=14 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 19 00:02:51 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=170,cinder:DELETE=19,cinder:SELECT=119,cinder:INSERT=40 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Flow 'volume_create_manager' (49dd1709-c815-4f9b-962c-3812334fff5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c41818-d304-4f45-bf3f-1a3daff5fca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c41818-d304-4f45-bf3f-1a3daff5fca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2085382447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c021fcf-c049-41f8-befc-13e9d45e08ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665e7566953c4ce491d248f544297286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:54Z,use_quota=True,user_id='35466d84a8004bd68c420fa85fdab5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1424894a-ca00-4a11-b1c0-b8db51acb6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1424894a-ca00-4a11-b1c0-b8db51acb6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9079f4ea-cd64-42cc-883d-b3511fa3dffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9079f4ea-cd64-42cc-883d-b3511fa3dffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c021fcf-c049-41f8-befc-13e9d45e08ff', 'volume_name': 'volume-8c021fcf-c049-41f8-befc-13e9d45e08ff', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92b070c-e073-4f13-bd2e-66660e8352ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92b070c-e073-4f13-bd2e-66660e8352ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849c7210-bdcb-4d2a-ac09-508142bfa389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Volume 8c021fcf-c049-41f8-befc-13e9d45e08ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c021fcf-c049-41f8-befc-13e9d45e08ff', 'volume_size': 1} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2085382447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c021fcf-c049-41f8-befc-13e9d45e08ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665e7566953c4ce491d248f544297286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:54Z,use_quota=True,user_id='35466d84a8004bd68c420fa85fdab5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Creating volume 8c021fcf-c049-41f8-befc-13e9d45e08ff {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:54 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:54 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff 1073741824 Sep 19 00:02:54 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Flow 'volume_create_manager' (b4d810eb-15a5-40fb-b225-be65912cd321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bfca4e-2678-4c10-9096-d179ba0abe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bfca4e-2678-4c10-9096-d179ba0abe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-835755336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1621ee-bfa3-483f-8fc0-1837c806c409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd079b377ce4f47883771c096eb5d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:54Z,use_quota=True,user_id='39ec5ad28c3a44c49a4fc81bc061d456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631460b5-d850-4b51-8998-31ea7abd202c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631460b5-d850-4b51-8998-31ea7abd202c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c9c259-790d-441d-88ec-12b53449e46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93c9c259-790d-441d-88ec-12b53449e46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec1621ee-bfa3-483f-8fc0-1837c806c409', 'volume_name': 'volume-ec1621ee-bfa3-483f-8fc0-1837c806c409', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ff4548-4d88-4917-8050-39a0d65ae0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ff4548-4d88-4917-8050-39a0d65ae0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52cf4ab-5ef6-4bf6-a9f5-f27766ad92b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Volume ec1621ee-bfa3-483f-8fc0-1837c806c409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec1621ee-bfa3-483f-8fc0-1837c806c409', 'volume_size': 1} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Flow 'volume_create_manager' (1d1e2c2f-3342-4045-a4e0-3f8b1df52d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7af5db-3c41-4e11-9c2d-f322ced95b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7af5db-3c41-4e11-9c2d-f322ced95b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714990921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40439c27-ae1c-4e74-8d81-93532ae2cb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd079b377ce4f47883771c096eb5d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:54Z,use_quota=True,user_id='39ec5ad28c3a44c49a4fc81bc061d456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1be306-7eef-49ea-9d1a-ba2ce0010059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1be306-7eef-49ea-9d1a-ba2ce0010059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1383ef0d-5d0c-4163-9b5b-d71080ce67cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1383ef0d-5d0c-4163-9b5b-d71080ce67cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40439c27-ae1c-4e74-8d81-93532ae2cb1e', 'volume_name': 'volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fea559-d7e3-4217-83be-ee2f6a7c7a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fea559-d7e3-4217-83be-ee2f6a7c7a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1bcfd4-053a-4c8f-96db-8f5abb7cd804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Volume 40439c27-ae1c-4e74-8d81-93532ae2cb1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e', 'volume_size': 1} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:54 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff 1073741824" returned: 0 in 0.691s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:55 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff Sep 19 00:02:55 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (3eb7e541-f68f-43fa-895f-944aec302edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b60d82-3a4d-4a73-933b-fc534808e7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b60d82-3a4d-4a73-933b-fc534808e7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427495806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee15a33-c9f4-4353-8deb-783f4734680e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:55Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65277bb9-8fbf-4cd7-86d4-59bfede316ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65277bb9-8fbf-4cd7-86d4-59bfede316ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bffd6dd-50eb-41bb-b44f-28e5fe6b8ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bffd6dd-50eb-41bb-b44f-28e5fe6b8ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee15a33-c9f4-4353-8deb-783f4734680e', 'volume_name': 'volume-bee15a33-c9f4-4353-8deb-783f4734680e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21143331-7adf-47fa-8798-3de4a2acc195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21143331-7adf-47fa-8798-3de4a2acc195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f71833-40c6-4d60-ab6a-3c4e80aa0320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Volume bee15a33-c9f4-4353-8deb-783f4734680e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee15a33-c9f4-4353-8deb-783f4734680e', 'volume_size': 1} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Flow 'volume_create_manager' (2b25195b-4883-4110-947b-4d6e992264c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed77fa33-63f6-4293-8d6d-129a6a007511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff" returned: 0 in 0.426s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-835755336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1621ee-bfa3-483f-8fc0-1837c806c409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd079b377ce4f47883771c096eb5d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:54Z,use_quota=True,user_id='39ec5ad28c3a44c49a4fc81bc061d456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Creating volume ec1621ee-bfa3-483f-8fc0-1837c806c409 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:55 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ec1621ee-bfa3-483f-8fc0-1837c806c409 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:55 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ec1621ee-bfa3-483f-8fc0-1837c806c409 1073741824 Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed77fa33-63f6-4293-8d6d-129a6a007511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1253693809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8812954e-0789-4f86-a27e-2c5e85c97a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd079b377ce4f47883771c096eb5d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:55Z,use_quota=True,user_id='39ec5ad28c3a44c49a4fc81bc061d456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7ca800-faa4-483c-90f0-6187c6a9a8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7ca800-faa4-483c-90f0-6187c6a9a8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3a7b3e-6704-4928-9c0c-4462351d6873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3a7b3e-6704-4928-9c0c-4462351d6873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8812954e-0789-4f86-a27e-2c5e85c97a0a', 'volume_name': 'volume-8812954e-0789-4f86-a27e-2c5e85c97a0a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ec5d45-9ba1-4f54-9313-707d34ddc2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ec5d45-9ba1-4f54-9313-707d34ddc2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (336eccba-a7c4-444e-8874-812cc7c11fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Volume 8812954e-0789-4f86-a27e-2c5e85c97a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8812954e-0789-4f86-a27e-2c5e85c97a0a', 'volume_size': 1} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849c7210-bdcb-4d2a-ac09-508142bfa389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c021fcf-c049-41f8-befc-13e9d45e08ff', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d867cd-bcfe-4c86-919d-6588d9027de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Volume volume-8c021fcf-c049-41f8-befc-13e9d45e08ff (8c021fcf-c049-41f8-befc-13e9d45e08ff): created successfully Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d867cd-bcfe-4c86-919d-6588d9027de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Flow 'volume_create_manager' (49dd1709-c815-4f9b-962c-3812334fff5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Flow 'volume_create_manager' (a3572a6f-a4d4-4a41-8fbb-b4131ead4abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62dbc731-0aa9-4619-aaed-17df68e50cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f95839ef-9b3b-410d-8ff7-a2a51b336597 tempest-VolumeDependencyTests-2080965332 None] Created volume successfully. Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62dbc731-0aa9-4619-aaed-17df68e50cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1065250270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b898b10-d934-4976-aecc-69befaf74e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd079b377ce4f47883771c096eb5d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:55Z,use_quota=True,user_id='39ec5ad28c3a44c49a4fc81bc061d456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1f1fca-aa38-44a0-9894-144dc5849c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1f1fca-aa38-44a0-9894-144dc5849c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41277dde-3ccc-42fe-8570-bb1f9be75cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41277dde-3ccc-42fe-8570-bb1f9be75cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b898b10-d934-4976-aecc-69befaf74e2d', 'volume_name': 'volume-0b898b10-d934-4976-aecc-69befaf74e2d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd21cc17-c180-4093-bbe3-65655042a0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd21cc17-c180-4093-bbe3-65655042a0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6575034-8bb4-48bb-ad23-43b87915cf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Volume 0b898b10-d934-4976-aecc-69befaf74e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b898b10-d934-4976-aecc-69befaf74e2d', 'volume_size': 1} Sep 19 00:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Flow 'volume_create_manager' (ed3665b5-4a42-435f-a84a-b61b3f0e1fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8832a88b-a15f-4c4b-9718-1e05d4fef969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:56 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8832a88b-a15f-4c4b-9718-1e05d4fef969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-588409939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d588fa9b-73e4-4ab8-93bf-58577aa4cd8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd079b377ce4f47883771c096eb5d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:56Z,use_quota=True,user_id='39ec5ad28c3a44c49a4fc81bc061d456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34633f1e-0a50-4277-ba4b-1f50c71f7da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34633f1e-0a50-4277-ba4b-1f50c71f7da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2e13bc-fed9-45c9-a6a6-86dc297f7c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2e13bc-fed9-45c9-a6a6-86dc297f7c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd588fa9b-73e4-4ab8-93bf-58577aa4cd8f', 'volume_name': 'volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2bf759-f55e-48a5-8896-9fe5f2ee45e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2bf759-f55e-48a5-8896-9fe5f2ee45e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d91232d-0ed3-4497-b7ed-2ea58b8061fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:56 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Volume d588fa9b-73e4-4ab8-93bf-58577aa4cd8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f', 'volume_size': 1} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ec1621ee-bfa3-483f-8fc0-1837c806c409 1073741824" returned: 0 in 0.726s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ec1621ee-bfa3-483f-8fc0-1837c806c409 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:56 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ec1621ee-bfa3-483f-8fc0-1837c806c409 Sep 19 00:02:56 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:56 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ec1621ee-bfa3-483f-8fc0-1837c806c409" returned: 0 in 0.302s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.982s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714990921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40439c27-ae1c-4e74-8d81-93532ae2cb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd079b377ce4f47883771c096eb5d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:54Z,use_quota=True,user_id='39ec5ad28c3a44c49a4fc81bc061d456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Creating volume 40439c27-ae1c-4e74-8d81-93532ae2cb1e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:56 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52cf4ab-5ef6-4bf6-a9f5-f27766ad92b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1621ee-bfa3-483f-8fc0-1837c806c409', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:56 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e 1073741824 Sep 19 00:02:56 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b9ad16-34df-4237-b051-8e949ad493fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:56 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Volume volume-ec1621ee-bfa3-483f-8fc0-1837c806c409 (ec1621ee-bfa3-483f-8fc0-1837c806c409): created successfully Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b9ad16-34df-4237-b051-8e949ad493fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Flow 'volume_create_manager' (b4d810eb-15a5-40fb-b225-be65912cd321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1a1c15cc-5156-445d-91b5-03bc0f3f2eee tempest-CreateVolumesFromImageTest-1416319304 None] Created volume successfully. Sep 19 00:02:56 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e 1073741824" returned: 0 in 0.467s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:57 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e Sep 19 00:02:57 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:57 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e" returned: 0 in 0.264s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.048s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427495806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee15a33-c9f4-4353-8deb-783f4734680e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:55Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Creating volume bee15a33-c9f4-4353-8deb-783f4734680e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:57 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1bcfd4-053a-4c8f-96db-8f5abb7cd804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9f2cee-3ddc-4877-a9a6-d59ed28b35ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:57 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e 1073741824 Sep 19 00:02:57 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:57 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Volume volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e (40439c27-ae1c-4e74-8d81-93532ae2cb1e): created successfully Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9f2cee-3ddc-4877-a9a6-d59ed28b35ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Flow 'volume_create_manager' (1d1e2c2f-3342-4045-a4e0-3f8b1df52d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cb0d7529-52ab-413d-b867-772d9907ef92 tempest-CreateVolumesFromImageTest-1416319304 None] Created volume successfully. Sep 19 00:02:57 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e 1073741824" returned: 0 in 0.449s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:57 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e Sep 19 00:02:57 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:58 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e" returned: 0 in 0.245s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.494s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1253693809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8812954e-0789-4f86-a27e-2c5e85c97a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd079b377ce4f47883771c096eb5d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:55Z,use_quota=True,user_id='39ec5ad28c3a44c49a4fc81bc061d456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Creating volume 8812954e-0789-4f86-a27e-2c5e85c97a0a {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:58 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8812954e-0789-4f86-a27e-2c5e85c97a0a 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:58 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8812954e-0789-4f86-a27e-2c5e85c97a0a 1073741824 Sep 19 00:02:58 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f71833-40c6-4d60-ab6a-3c4e80aa0320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee15a33-c9f4-4353-8deb-783f4734680e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4979391-70a6-44fd-8da1-19f808d60894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Volume volume-bee15a33-c9f4-4353-8deb-783f4734680e (bee15a33-c9f4-4353-8deb-783f4734680e): created successfully Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4979391-70a6-44fd-8da1-19f808d60894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (3eb7e541-f68f-43fa-895f-944aec302edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Flow 'volume_create_manager' (37efacae-3bef-4e0e-be04-893826e0e502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d56890b-d1df-41e1-a317-f60caf41240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d56890b-d1df-41e1-a317-f60caf41240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89163ed-a7e1-42e2-beb5-73fa5b6d308a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3e055fd3014f6fbc906e0eb98c2b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:58Z,use_quota=True,user_id='0105b562a33f4bffb4d40e00dd4d2aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c389c11-3731-424c-8fe1-3e27d13a218e),volume_type_id=0c389c11-3731-424c-8fe1-3e27d13a218e)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25633238-fb3c-4aab-93aa-873363adfd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25633238-fb3c-4aab-93aa-873363adfd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (890fd5a8-a211-40cd-b673-e02422c90648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 19 00:02:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ea35a7ec-462a-46fd-808b-532622b58f65 tempest-ProjectMemberTests-883983225 None] Created volume successfully. Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (890fd5a8-a211-40cd-b673-e02422c90648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f89163ed-a7e1-42e2-beb5-73fa5b6d308a', 'volume_name': 'volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a', 'volume_size': 1, 'image_id': 'da2c26d8-d711-4824-ab17-9f86c537a11c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da2c26d8-d711-4824-ab17-9f86c537a11c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2fd752d3bd60ca1f82655aec6b714544', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd3e055fd3014f6fbc906e0eb98c2b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e39bd699598be15acff985621a9b841f25fac9ac5539f3dfb25d4691a54372e330377a8b3c4648e91af629c25781e81fdde097d4f3f74c52c9877645110ae92a', 'id': 'da2c26d8-d711-4824-ab17-9f86c537a11c', 'created_at': datetime.datetime(2026, 9, 18, 22, 2, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 22, 2, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da2c26d8-d711-4824-ab17-9f86c537a11c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a45ebb-1b69-4a20-9aa0-b63e49303c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99a45ebb-1b69-4a20-9aa0-b63e49303c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af921d42-b1db-4d4c-8a75-150feb8fce5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Volume f89163ed-a7e1-42e2-beb5-73fa5b6d308a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a', 'volume_size': 1, 'image_id': 'da2c26d8-d711-4824-ab17-9f86c537a11c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da2c26d8-d711-4824-ab17-9f86c537a11c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2fd752d3bd60ca1f82655aec6b714544', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd3e055fd3014f6fbc906e0eb98c2b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e39bd699598be15acff985621a9b841f25fac9ac5539f3dfb25d4691a54372e330377a8b3c4648e91af629c25781e81fdde097d4f3f74c52c9877645110ae92a', 'id': 'da2c26d8-d711-4824-ab17-9f86c537a11c', 'created_at': datetime.datetime(2026, 9, 18, 22, 2, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 22, 2, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da2c26d8-d711-4824-ab17-9f86c537a11c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Trying to clone f89163ed-a7e1-42e2-beb5-73fa5b6d308a from image da2c26d8-d711-4824-ab17-9f86c537a11c at location (None, [{'url': 'file:///opt/stack/data/glance/images/da2c26d8-d711-4824-ab17-9f86c537a11c', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 19 00:02:58 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8812954e-0789-4f86-a27e-2c5e85c97a0a 1073741824" returned: 0 in 0.507s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 19 00:02:58 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Image download 0.00 MB at 0.00 MB/s Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8812954e-0789-4f86-a27e-2c5e85c97a0a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:58 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8812954e-0789-4f86-a27e-2c5e85c97a0a Sep 19 00:02:58 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8922934-abaa-4a7c-8fda-64edefefcf79]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:58 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD Sep 19 00:02:58 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:58 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8812954e-0789-4f86-a27e-2c5e85c97a0a" returned: 0 in 0.247s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.124s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1065250270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b898b10-d934-4976-aecc-69befaf74e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd079b377ce4f47883771c096eb5d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:55Z,use_quota=True,user_id='39ec5ad28c3a44c49a4fc81bc061d456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Creating volume 0b898b10-d934-4976-aecc-69befaf74e2d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:58 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0b898b10-d934-4976-aecc-69befaf74e2d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (336eccba-a7c4-444e-8874-812cc7c11fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8812954e-0789-4f86-a27e-2c5e85c97a0a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:58 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0b898b10-d934-4976-aecc-69befaf74e2d 1073741824 Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd5653d-5973-4340-ab2d-deaa090c8d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:58 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Volume volume-8812954e-0789-4f86-a27e-2c5e85c97a0a (8812954e-0789-4f86-a27e-2c5e85c97a0a): created successfully Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd5653d-5973-4340-ab2d-deaa090c8d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Flow 'volume_create_manager' (2b25195b-4883-4110-947b-4d6e992264c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-bbac38e3-df8a-4471-93cd-a29656683516 tempest-CreateVolumesFromImageTest-1416319304 None] Created volume successfully. Sep 19 00:02:58 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:59 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD Sep 19 00:02:59 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:59 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Temporary image da2c26d8-d711-4824-ab17-9f86c537a11c is fetched for user 0105b562a33f4bffb4d40e00dd4d2aa5. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 19 00:02:59 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0b898b10-d934-4976-aecc-69befaf74e2d 1073741824" returned: 0 in 0.514s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0b898b10-d934-4976-aecc-69befaf74e2d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:59 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0b898b10-d934-4976-aecc-69befaf74e2d Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[da987426-cad4-4fac-bfb8-2bdd069a9052]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:02:59 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:59 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD Sep 19 00:02:59 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:59 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0b898b10-d934-4976-aecc-69befaf74e2d" returned: 0 in 0.282s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.537s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-588409939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d588fa9b-73e4-4ab8-93bf-58577aa4cd8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd079b377ce4f47883771c096eb5d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:56Z,use_quota=True,user_id='39ec5ad28c3a44c49a4fc81bc061d456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Creating volume d588fa9b-73e4-4ab8-93bf-58577aa4cd8f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:02:59 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:59 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f 1073741824 Sep 19 00:02:59 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6575034-8bb4-48bb-ad23-43b87915cf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b898b10-d934-4976-aecc-69befaf74e2d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06bc4198-fc0b-47dd-ae27-0c5044ffc919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:02:59 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Volume volume-0b898b10-d934-4976-aecc-69befaf74e2d (0b898b10-d934-4976-aecc-69befaf74e2d): created successfully Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06bc4198-fc0b-47dd-ae27-0c5044ffc919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Flow 'volume_create_manager' (a3572a6f-a4d4-4a41-8fbb-b4131ead4abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:02:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b341d618-19e9-46bc-b1a5-9c39af6642c8 tempest-CreateVolumesFromImageTest-1416319304 None] Created volume successfully. Sep 19 00:02:59 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:02:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:02:59 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD Sep 19 00:02:59 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:00 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f 1073741824" returned: 0 in 0.408s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:00 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:00 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f Sep 19 00:03:00 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:00 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f" returned: 0 in 0.255s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.120s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] Creating offline snapshot e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 of volume 8c021fcf-c049-41f8-befc-13e9d45e08ff {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d91232d-0ed3-4497-b7ed-2ea58b8061fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae73506-b1b9-4ea2-a56b-451c23f818b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe55294-39dd-441e-9038-9565deaf5ae1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Volume volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f (d588fa9b-73e4-4ab8-93bf-58577aa4cd8f): created successfully Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae73506-b1b9-4ea2-a56b-451c23f818b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Flow 'volume_create_manager' (ed3665b5-4a42-435f-a84a-b61b3f0e1fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b8544b66-e675-4a01-bfe2-d729297195e3 tempest-CreateVolumesFromImageTest-1416319304 None] Created volume successfully. Sep 19 00:03:00 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff Sep 19 00:03:00 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:00 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff" returned: 0 in 0.370s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:00 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 1G Sep 19 00:03:00 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:01 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 1G" returned: 0 in 0.393s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c021fcf-c049-41f8-befc-13e9d45e08ff -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:01 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c021fcf-c049-41f8-befc-13e9d45e08ff -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 Sep 19 00:03:01 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:01 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c021fcf-c049-41f8-befc-13e9d45e08ff -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467" returned: 0 in 0.293s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:01 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 is being set with open permissions: ugo+rw Sep 19 00:03:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:01 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 Sep 19 00:03:01 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "cinder-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "cinder-quobyte-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-quobyte-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b222a65-3128-4c05-a3a6-8d183910704e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:01 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467" returned: 0 in 0.267s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:01 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f Sep 19 00:03:01 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:01 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.info Sep 19 00:03:01 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:02 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f" returned: 0 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:02 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f Sep 19 00:03:02 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:02 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.info" returned: 0 in 0.275s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:02 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.info is being set with open permissions: ugo+rw Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:02 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.info Sep 19 00:03:02 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:02 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f" returned: 0 in 0.272s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-quobyte-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f" released by "delete_volume" :: held 0.689s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:02 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.info" returned: 0 in 0.262s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.703s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] Creating offline snapshot 5923206b-1af0-403c-8dc3-ef828177c1a6 of volume bee15a33-c9f4-4353-8deb-783f4734680e {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:03:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f0af3c1c-329f-44c4-a226-f4fc0f219b43 tempest-VolumeDependencyTests-2080965332 None] Create snapshot completed successfully Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a138955b-1201-46d9-aacf-9fd0cc6edb30]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Created reservations ['e347c06b-1d1d-4f5a-a899-3e995a17156e', 'f157fc63-1553-462e-89b2-be3e62ffd05f', '837f64c5-6796-47e7-b7f2-de0f88dc73fc', '333c3fda-73fc-42c7-aa9d-d2237184704b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:02 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e Sep 19 00:03:02 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:02 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:02 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "cinder-0b898b10-d934-4976-aecc-69befaf74e2d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-0b898b10-d934-4976-aecc-69befaf74e2d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:02 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:02 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "cinder-quobyte-0b898b10-d934-4976-aecc-69befaf74e2d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Deleted volume successfully. Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e" returned: 0 in 0.485s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-quobyte-0b898b10-d934-4976-aecc-69befaf74e2d" acquired by "delete_volume" :: waited 0.048s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:02 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 1G Sep 19 00:03:02 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4755dad2-0e6d-41da-a5bc-c6ff88945b84 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-d588fa9b-73e4-4ab8-93bf-58577aa4cd8f-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1b9dfd-b824-49d4-9d1f-5e3388cff501]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0b898b10-d934-4976-aecc-69befaf74e2d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:03 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0b898b10-d934-4976-aecc-69befaf74e2d Sep 19 00:03:03 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Flow 'volume_create_manager' (d316c2c3-70ef-49d1-b3e5-81168ceeca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10546e5c-c56b-41c7-84f9-ff8c1b6ebb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10546e5c-c56b-41c7-84f9-ff8c1b6ebb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-735415332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='665e7566953c4ce491d248f544297286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e6f8eba1-27a4-46c0-9842-4ecfd7f0a467,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:03Z,use_quota=True,user_id='35466d84a8004bd68c420fa85fdab5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bff1762-c913-4122-9988-65cd1a605303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bff1762-c913-4122-9988-65cd1a605303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616a8e3e-1f3e-4612-9f64-545c6db96c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616a8e3e-1f3e-4612-9f64-545c6db96c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7', 'volume_name': 'volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7', 'volume_size': 1, 'snapshot_id': 'e6f8eba1-27a4-46c0-9842-4ecfd7f0a467'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0c611e-84ba-48de-bf67-d02897f402af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0c611e-84ba-48de-bf67-d02897f402af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6942bb8-8abd-427a-ab3f-3529e5dbde90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Volume 9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7', 'volume_size': 1, 'snapshot_id': 'e6f8eba1-27a4-46c0-9842-4ecfd7f0a467'} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:03 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 1G" returned: 0 in 0.514s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee15a33-c9f4-4353-8deb-783f4734680e -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:03 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:03 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee15a33-c9f4-4353-8deb-783f4734680e -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 Sep 19 00:03:03 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0b898b10-d934-4976-aecc-69befaf74e2d" returned: 0 in 0.473s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0b898b10-d934-4976-aecc-69befaf74e2d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:03 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0b898b10-d934-4976-aecc-69befaf74e2d Sep 19 00:03:03 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:03 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-0b898b10-d934-4976-aecc-69befaf74e2d" returned: 0 in 0.244s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-quobyte-0b898b10-d934-4976-aecc-69befaf74e2d" released by "delete_volume" :: held 0.786s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:03 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee15a33-c9f4-4353-8deb-783f4734680e -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6" returned: 0 in 0.314s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:03 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 is being set with open permissions: ugo+rw Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:03 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 Sep 19 00:03:03 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Created reservations ['5795bf3f-fc69-4b37-b208-7daa064286c5', 'e1deddac-ec11-4c51-af6f-bc3497f8ee30', 'd5f6e34b-3f95-47a0-ba7c-d61b9c65a585', '25dc5198-b15a-4c54-a464-e35b030ae630'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:03 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:03 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:03 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6" returned: 0 in 0.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "cinder-8812954e-0789-4f86-a27e-2c5e85c97a0a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-8812954e-0789-4f86-a27e-2c5e85c97a0a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:04 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.info Sep 19 00:03:04 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "cinder-quobyte-8812954e-0789-4f86-a27e-2c5e85c97a0a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-quobyte-8812954e-0789-4f86-a27e-2c5e85c97a0a" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:04 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Deleted volume successfully. Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6b1f7f-fe12-49f0-b9c0-aee2c53ba26b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8812954e-0789-4f86-a27e-2c5e85c97a0a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f022a3c6-d000-4e48-90e6-8d465b2f6a10 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-0b898b10-d934-4976-aecc-69befaf74e2d-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:04 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8812954e-0789-4f86-a27e-2c5e85c97a0a Sep 19 00:03:04 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:04 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.info" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:04 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.info is being set with open permissions: ugo+rw Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:04 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.info Sep 19 00:03:04 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:04 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8812954e-0789-4f86-a27e-2c5e85c97a0a" returned: 0 in 0.376s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8812954e-0789-4f86-a27e-2c5e85c97a0a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:04 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8812954e-0789-4f86-a27e-2c5e85c97a0a Sep 19 00:03:04 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:04 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.info" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.268s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.478s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89163ed-a7e1-42e2-beb5-73fa5b6d308a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3e055fd3014f6fbc906e0eb98c2b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:02:58Z,use_quota=True,user_id='0105b562a33f4bffb4d40e00dd4d2aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c389c11-3731-424c-8fe1-3e27d13a218e),volume_type_id=0c389c11-3731-424c-8fe1-3e27d13a218e)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Creating volume f89163ed-a7e1-42e2-beb5-73fa5b6d308a {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:04 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:04 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a 1073741824 Sep 19 00:03:04 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-91b9501a-463c-4d8b-bca6-3702f6355252 tempest-ProjectMemberTests-883983225 None] Create snapshot completed successfully Sep 19 00:03:04 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8812954e-0789-4f86-a27e-2c5e85c97a0a" returned: 0 in 0.264s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-quobyte-8812954e-0789-4f86-a27e-2c5e85c97a0a" released by "delete_volume" :: held 0.698s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Created reservations ['20c7f462-eb42-4505-8a47-dcf3e81d9eb1', 'fa8de3c4-9983-48be-b256-deff8a2e9550', 'cc767256-9bf4-4478-a8b0-766670315021', '16cec7cf-7edc-48de-a899-e48e609d7e71'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:04 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:04 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-5923206b-1af0-403c-8dc3-ef828177c1a6-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Lock "cinder-5923206b-1af0-403c-8dc3-ef828177c1a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-bee15a33-c9f4-4353-8deb-783f4734680e" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-bee15a33-c9f4-4353-8deb-783f4734680e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-5923206b-1af0-403c-8dc3-ef828177c1a6" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-5923206b-1af0-403c-8dc3-ef828177c1a6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Deleting offline snapshot 5923206b-1af0-403c-8dc3-ef828177c1a6 of volume bee15a33-c9f4-4353-8deb-783f4734680e {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] snapshot_file for this snap is: volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6de8e4b-1950-43da-a2b3-0833c6c96ac9]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:05 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "cinder-40439c27-ae1c-4e74-8d81-93532ae2cb1e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:05 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:05 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 Sep 19 00:03:05 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a 1073741824" returned: 0 in 0.590s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Deleted volume successfully. Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-40439c27-ae1c-4e74-8d81-93532ae2cb1e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c74360a-b1cb-40cf-82e6-cf409b29017f tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-8812954e-0789-4f86-a27e-2c5e85c97a0a-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "cinder-quobyte-40439c27-ae1c-4e74-8d81-93532ae2cb1e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-quobyte-40439c27-ae1c-4e74-8d81-93532ae2cb1e" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:05 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a Sep 19 00:03:05 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[818761b5-13d0-4a35-9f17-2eed0fae5304]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:05 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e Sep 19 00:03:05 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:05 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6" returned: 0 in 0.444s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bee15a33-c9f4-4353-8deb-783f4734680e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b5fa74-7991-4fcf-a5ac-1d1531c834b4]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:05 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a" returned: 0 in 0.271s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.334s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "cinder-quobyte-e6f8eba1-27a4-46c0-9842-4ecfd7f0a467-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-quobyte-e6f8eba1-27a4-46c0-9842-4ecfd7f0a467-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Creating volume 9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 from snapshot e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "cinder-quobyte-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Attempting download of da2c26d8-d711-4824-ab17-9f86c537a11c ((None, [{'url': 'file:///opt/stack/data/glance/images/da2c26d8-d711-4824-ab17-9f86c537a11c', 'metadata': {}}])) to volume f89163ed-a7e1-42e2-beb5-73fa5b6d308a. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-quobyte-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] snapshot: e6f8eba1-27a4-46c0-9842-4ecfd7f0a467, volume: 9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 19 00:03:05 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e Sep 19 00:03:05 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[92905c23-dda9-4256-a2f0-850891cd1334]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19b30fe-8723-4f03-88b6-df9004ed30aa]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da2c26d8-d711-4824-ab17-9f86c537a11c_l23ed384 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:05 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:05 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e Sep 19 00:03:05 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:05 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 Sep 19 00:03:05 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:05 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da2c26d8-d711-4824-ab17-9f86c537a11c_l23ed384 Sep 19 00:03:05 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:05 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e" returned: 0 in 0.380s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:05 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 Sep 19 00:03:05 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:06 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:06 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da2c26d8-d711-4824-ab17-9f86c537a11c_l23ed384" returned: 0 in 0.363s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da2c26d8-d711-4824-ab17-9f86c537a11c_l23ed384 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-40439c27-ae1c-4e74-8d81-93532ae2cb1e" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:06 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-quobyte-40439c27-ae1c-4e74-8d81-93532ae2cb1e" released by "delete_volume" :: held 0.812s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467" returned: 0 in 0.430s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c021fcf-c049-41f8-befc-13e9d45e08ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fdd9dc-ed71-4265-afb7-62a509e30b46]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Created reservations ['ceff9d1b-89f0-4ef4-aa9f-346e7d91cac1', 'e03a381e-dc2a-49b3-81df-2f5e7e3b2967', '6bebb1f6-8932-4d94-b5b1-7c9abd682644', '84d9506a-67a3-4864-b23b-c98875ec94a0'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:06 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da2c26d8-d711-4824-ab17-9f86c537a11c_l23ed384 Sep 19 00:03:06 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:06 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff Sep 19 00:03:06 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:06 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:06 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:06 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6" returned: 0 in 0.516s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "cinder-ec1621ee-bfa3-483f-8fc0-1837c806c409-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-ec1621ee-bfa3-483f-8fc0-1837c806c409-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:06 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6 Sep 19 00:03:06 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "cinder-quobyte-ec1621ee-bfa3-483f-8fc0-1837c806c409" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-quobyte-ec1621ee-bfa3-483f-8fc0-1837c806c409" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d4a5f2-dd2e-4aea-82c6-1921854c35f4]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ec1621ee-bfa3-483f-8fc0-1837c806c409 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:06 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:06 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da2c26d8-d711-4824-ab17-9f86c537a11c_l23ed384" returned: 1 in 0.567s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da2c26d8-d711-4824-ab17-9f86c537a11c_l23ed384' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:03:06 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.364s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb416055-a3f1-4eb9-a4c1-3a5549886436]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff" returned: 0 in 0.535s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Path /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:06 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Deleted volume successfully. Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e0216338-fd6d-4f88-b44e-5b59fb168844 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-40439c27-ae1c-4e74-8d81-93532ae2cb1e-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:06 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 Sep 19 00:03:06 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:06 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ec1621ee-bfa3-483f-8fc0-1837c806c409 Sep 19 00:03:06 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:06 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD Sep 19 00:03:06 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:06 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e.5923206b-1af0-403c-8dc3-ef828177c1a6" returned: 0 in 0.380s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-5923206b-1af0-403c-8dc3-ef828177c1a6" released by "_delete_snapshot" :: held 1.867s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-bee15a33-c9f4-4353-8deb-783f4734680e" released by "delete_snapshot" :: held 1.892s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:06 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Created reservations ['8f153d8f-e407-4fac-aa5b-dfb54f9c4dd6', '5e6ce158-ac67-4930-8280-106dea73ae16', 'ae265353-4e13-4583-a618-fb73219cb959', '08892563-c209-427f-ba0a-0d37b78a5c0b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Delete snapshot completed successfully. Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-913e382a-5072-47c9-9058-280fb47b1121 tempest-ProjectMemberTests-883983225 None] Lock "cinder-5923206b-1af0-403c-8dc3-ef828177c1a6-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:07 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:07 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ec1621ee-bfa3-483f-8fc0-1837c806c409" returned: 0 in 0.461s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ec1621ee-bfa3-483f-8fc0-1837c806c409 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:07 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ec1621ee-bfa3-483f-8fc0-1837c806c409 Sep 19 00:03:07 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-bee15a33-c9f4-4353-8deb-783f4734680e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Lock "cinder-bee15a33-c9f4-4353-8deb-783f4734680e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:07 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD Sep 19 00:03:07 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-bee15a33-c9f4-4353-8deb-783f4734680e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-bee15a33-c9f4-4353-8deb-783f4734680e" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a39366-b1c7-4c12-baa3-7c68036b36e9]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:07 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ec1621ee-bfa3-483f-8fc0-1837c806c409" returned: 0 in 0.477s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-quobyte-ec1621ee-bfa3-483f-8fc0-1837c806c409" released by "delete_volume" :: held 1.029s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:07 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD" returned: 1 in 0.569s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] da2c26d8-d711-4824-ab17-9f86c537a11c was raw, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 19 00:03:07 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e Sep 19 00:03:07 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:07 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a Sep 19 00:03:07 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Created reservations ['9c63d0df-eae9-4cd8-96fa-8f9e750a782a', '07fc09d5-c11c-4cbe-80b9-cdaa12d4541c', '05e5beec-32dd-4118-b1f2-59f8f61d0935', 'b32d9a4d-61ca-4727-91b4-a8c6003ceebf'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:08 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:08 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:08 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e" returned: 0 in 0.735s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:08 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e Sep 19 00:03:08 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:08 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.583s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Deleted volume successfully. Sep 19 00:03:08 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bee15a33-c9f4-4353-8deb-783f4734680e" returned: 0 in 0.493s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-bee15a33-c9f4-4353-8deb-783f4734680e" released by "delete_volume" :: held 1.408s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-63342ab1-7513-4cb3-96bd-545c0d81da19 tempest-CreateVolumesFromImageTest-1416319304 None] Lock "cinder-ec1621ee-bfa3-483f-8fc0-1837c806c409-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:08 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a" returned: 0 in 1.177s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_da2c26d8-d711-4824-ab17-9f86c537a11c_1652qrxmdevstack@QuobyteHD, size 0.00 MB, duration 1.18 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 19 00:03:08 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Converted 0.00 MB image at 0.00 MB/s Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:08 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Created reservations ['d78565f2-2be1-4ea4-ac14-e54ae6bc7330', 'baba89b1-e4f8-424b-81ed-7c507f8cb8a5', '67834d70-18d2-4dda-91d7-67c779f3e665', 'ac538876-3fec-4f96-a639-c248e5d3b39e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:08 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a 1G Sep 19 00:03:08 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:09 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:09 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:09 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.525s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Deleted volume successfully. Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-51ff90e7-3938-44de-8efd-cc117e747771 tempest-ProjectMemberTests-883983225 None] Lock "cinder-bee15a33-c9f4-4353-8deb-783f4734680e-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:09 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a 1G" returned: 0 in 0.964s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Downloaded image da2c26d8-d711-4824-ab17-9f86c537a11c ((None, [{'url': 'file:///opt/stack/data/glance/images/da2c26d8-d711-4824-ab17-9f86c537a11c', 'metadata': {}}])) to volume f89163ed-a7e1-42e2-beb5-73fa5b6d308a successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Temporary image da2c26d8-d711-4824-ab17-9f86c537a11c for user 0105b562a33f4bffb4d40e00dd4d2aa5 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Marking volume f89163ed-a7e1-42e2-beb5-73fa5b6d308a as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Copying metadata from image da2c26d8-d711-4824-ab17-9f86c537a11c to f89163ed-a7e1-42e2-beb5-73fa5b6d308a. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 19 00:03:09 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Creating volume glance metadata for volume f89163ed-a7e1-42e2-beb5-73fa5b6d308a backed by image da2c26d8-d711-4824-ab17-9f86c537a11c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'da2c26d8-d711-4824-ab17-9f86c537a11c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2fd752d3bd60ca1f82655aec6b714544', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af921d42-b1db-4d4c-8a75-150feb8fce5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a', 'volume_size': 1, 'image_id': 'da2c26d8-d711-4824-ab17-9f86c537a11c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da2c26d8-d711-4824-ab17-9f86c537a11c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2fd752d3bd60ca1f82655aec6b714544', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd3e055fd3014f6fbc906e0eb98c2b55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e39bd699598be15acff985621a9b841f25fac9ac5539f3dfb25d4691a54372e330377a8b3c4648e91af629c25781e81fdde097d4f3f74c52c9877645110ae92a', 'id': 'da2c26d8-d711-4824-ab17-9f86c537a11c', 'created_at': datetime.datetime(2026, 9, 18, 22, 2, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 22, 2, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da2c26d8-d711-4824-ab17-9f86c537a11c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a84717b-246a-4a1f-acfb-a1fd6a8b3d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Volume volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a (f89163ed-a7e1-42e2-beb5-73fa5b6d308a): created successfully Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a84717b-246a-4a1f-acfb-a1fd6a8b3d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Flow 'volume_create_manager' (37efacae-3bef-4e0e-be04-893826e0e502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d5290dff-8a34-42ff-84ce-bbd89f0781fd tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Created volume successfully. Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (5d413f6c-09ad-4857-b7d1-885dacd013b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85de8adb-613a-4bed-bd2c-148021da94ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85de8adb-613a-4bed-bd2c-148021da94ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-947732722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33a4018-a9af-4225-9938-5d39fb1457ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:11Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4e8ab8-cc5f-4e84-9080-f3e40b3d29cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4e8ab8-cc5f-4e84-9080-f3e40b3d29cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62337c55-9e29-4f32-93e3-7256354ff498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62337c55-9e29-4f32-93e3-7256354ff498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c33a4018-a9af-4225-9938-5d39fb1457ce', 'volume_name': 'volume-c33a4018-a9af-4225-9938-5d39fb1457ce', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b53815-c746-40ea-a808-191ac61d4b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b53815-c746-40ea-a808-191ac61d4b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673fffbb-79fa-4582-a562-acb873189fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Volume c33a4018-a9af-4225-9938-5d39fb1457ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c33a4018-a9af-4225-9938-5d39fb1457ce', 'volume_size': 1} Sep 19 00:03:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Acquiring lock "cinder-f89163ed-a7e1-42e2-beb5-73fa5b6d308a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Lock "cinder-f89163ed-a7e1-42e2-beb5-73fa5b6d308a-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Acquiring lock "cinder-quobyte-f89163ed-a7e1-42e2-beb5-73fa5b6d308a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Lock "cinder-quobyte-f89163ed-a7e1-42e2-beb5-73fa5b6d308a" acquired by "delete_volume" :: waited 0.052s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:11 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7f3949-caf2-484c-918e-4131804701af]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:11 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a Sep 19 00:03:11 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:12 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a" returned: 0 in 0.676s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:12 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a Sep 19 00:03:12 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:12 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f89163ed-a7e1-42e2-beb5-73fa5b6d308a" returned: 0 in 0.468s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Lock "cinder-quobyte-f89163ed-a7e1-42e2-beb5-73fa5b6d308a" released by "delete_volume" :: held 1.237s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:12 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Created reservations ['23228818-04f2-4449-ad2f-4d4f78780018', '46f77bad-7ab4-488d-a61c-45cf62c8f166', 'd1ca7004-bf59-4f9b-84ed-9e930d2762cf', '621281a9-c2e6-43a0-a79c-6fdc7c5c0b0b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:12 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:12 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:13 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.324s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:13 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Deleted volume successfully. Sep 19 00:03:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ab746ac-c9b4-417b-a271-42e14117750c tempest-VolumeAndVolumeTypeFromImageTest-789459503 None] Lock "cinder-f89163ed-a7e1-42e2-beb5-73fa5b6d308a-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:15 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" returned: 0 in 9.146s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:15 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff, size 1024.00 MB, duration 9.15 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 19 00:03:15 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Converted 1024.00 MB image at 111.94 MB/s Sep 19 00:03:15 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 is being set with open permissions: ugo+rw Sep 19 00:03:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:15 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 Sep 19 00:03:15 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:16 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-quobyte-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" released by "_copy_volume_from_snapshot" :: held 10.508s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-quobyte-e6f8eba1-27a4-46c0-9842-4ecfd7f0a467-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" released by "_create_volume_from_snapshot" :: held 10.587s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.616s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.294s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-947732722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33a4018-a9af-4225-9938-5d39fb1457ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:11Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Creating volume c33a4018-a9af-4225-9938-5d39fb1457ce {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:16 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:16 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce 1073741824 Sep 19 00:03:16 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6942bb8-8abd-427a-ab3f-3529e5dbde90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7', 'volume_size': 1, 'snapshot_id': 'e6f8eba1-27a4-46c0-9842-4ecfd7f0a467'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdaea0b-a17e-439d-88e3-8a2d3771d16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:16 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Volume volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 (9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7): created successfully Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdaea0b-a17e-439d-88e3-8a2d3771d16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Flow 'volume_create_manager' (d316c2c3-70ef-49d1-b3e5-81168ceeca9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d51d10f5-485b-45cb-a851-9658774c23a3 tempest-VolumeDependencyTests-2080965332 None] Created volume successfully. Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "cinder-e6f8eba1-27a4-46c0-9842-4ecfd7f0a467-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-e6f8eba1-27a4-46c0-9842-4ecfd7f0a467-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "cinder-quobyte-8c021fcf-c049-41f8-befc-13e9d45e08ff" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-quobyte-8c021fcf-c049-41f8-befc-13e9d45e08ff" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "cinder-quobyte-e6f8eba1-27a4-46c0-9842-4ecfd7f0a467" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-quobyte-e6f8eba1-27a4-46c0-9842-4ecfd7f0a467" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Deleting offline snapshot e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 of volume 8c021fcf-c049-41f8-befc-13e9d45e08ff {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] snapshot_file for this snap is: volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af3b576-e8c1-4bb6-b958-d46a4bf19ed6]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:16 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce 1073741824" returned: 0 in 0.639s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:16 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 Sep 19 00:03:16 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:16 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce Sep 19 00:03:16 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:17 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467" returned: 0 in 0.437s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c021fcf-c049-41f8-befc-13e9d45e08ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:03:17 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce" returned: 0 in 0.321s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673fffbb-79fa-4582-a562-acb873189fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c33a4018-a9af-4225-9938-5d39fb1457ce', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b70670-9a25-4f62-9cda-652fdf2b8ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[460a32f4-ccb4-427f-943e-f987121bb5cf]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:17 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Volume volume-c33a4018-a9af-4225-9938-5d39fb1457ce (c33a4018-a9af-4225-9938-5d39fb1457ce): created successfully Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b70670-9a25-4f62-9cda-652fdf2b8ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (5d413f6c-09ad-4857-b7d1-885dacd013b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e5a98704-a037-4072-aeab-c22241742147 tempest-ProjectMemberTests-883983225 None] Created volume successfully. Sep 19 00:03:17 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff Sep 19 00:03:17 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:17 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff" returned: 0 in 0.616s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:17 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 Sep 19 00:03:17 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:18 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467" returned: 0 in 0.396s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:18 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467 Sep 19 00:03:18 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Flow 'volume_create_manager' (7f52e702-d019-4ec7-91ef-83510007ae93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba616815-f70f-4c1d-bec8-cb3bb5a4af96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba616815-f70f-4c1d-bec8-cb3bb5a4af96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3761f20e-a31d-45c5-9bf0-6b2673afe5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606b768e0be34ad2ba48e9d0755b1f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:18Z,use_quota=True,user_id='1912e748fe39433c81e95e1a3a9c67c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9c167b-f4de-4868-8898-abfefc839274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9c167b-f4de-4868-8898-abfefc839274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc273657-feb0-4537-9a2a-0da7355ffac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] Creating offline snapshot 6202b067-ccca-4453-adad-cd8462e80a98 of volume c33a4018-a9af-4225-9938-5d39fb1457ce {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:03:18 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff.e6f8eba1-27a4-46c0-9842-4ecfd7f0a467" returned: 0 in 0.466s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bc992b-7601-4b9b-8424-bc2b96c8f243]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-quobyte-e6f8eba1-27a4-46c0-9842-4ecfd7f0a467" released by "_delete_snapshot" :: held 2.100s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-quobyte-8c021fcf-c049-41f8-befc-13e9d45e08ff" released by "delete_snapshot" :: held 2.148s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Created reservations ['b185f411-115b-4e0e-a4ac-1f469c0741c3', '1e51c83f-5bfd-4959-84a5-e7d5ba01bf8f', 'd9460071-182b-4864-b76e-525a212a36ba', 'a2e6ef21-d102-498c-86c2-14cde0257535'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:18 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce Sep 19 00:03:18 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Delete snapshot completed successfully. Sep 19 00:03:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b2a0ab54-fe96-4347-9723-f0c26b71946e tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-e6f8eba1-27a4-46c0-9842-4ecfd7f0a467-delete_snapshot" released by "delete_snapshot" :: held 2.363s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc273657-feb0-4537-9a2a-0da7355ffac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3761f20e-a31d-45c5-9bf0-6b2673afe5e1', 'volume_name': 'volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1', 'volume_size': 1, 'image_id': 'e7bcca4e-1724-4e52-ae14-0b1a867db830', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7bcca4e-1724-4e52-ae14-0b1a867db830', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '61dac7d036a1825c8cfc3be4c5c7f398', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '606b768e0be34ad2ba48e9d0755b1f8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '57fb350ce7574e596f7b8aea8cabc9d4a2698f7f9029b1fde8e38ba847a610ea0d174a2f1b4e15ade91bc12f676a00605eb1431dc6cf8482f5b351e0f77633e4', 'id': 'e7bcca4e-1724-4e52-ae14-0b1a867db830', 'created_at': datetime.datetime(2026, 9, 18, 22, 3, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 22, 3, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7bcca4e-1724-4e52-ae14-0b1a867db830/file', 'properties': {}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b7a5b1-fb7a-4e42-a649-f87d182c7cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b7a5b1-fb7a-4e42-a649-f87d182c7cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c937e335-bc2d-48da-9f11-ea9ccb777c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Volume 3761f20e-a31d-45c5-9bf0-6b2673afe5e1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1', 'volume_size': 1, 'image_id': 'e7bcca4e-1724-4e52-ae14-0b1a867db830', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7bcca4e-1724-4e52-ae14-0b1a867db830', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '61dac7d036a1825c8cfc3be4c5c7f398', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '606b768e0be34ad2ba48e9d0755b1f8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '57fb350ce7574e596f7b8aea8cabc9d4a2698f7f9029b1fde8e38ba847a610ea0d174a2f1b4e15ade91bc12f676a00605eb1431dc6cf8482f5b351e0f77633e4', 'id': 'e7bcca4e-1724-4e52-ae14-0b1a867db830', 'created_at': datetime.datetime(2026, 9, 18, 22, 3, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 22, 3, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7bcca4e-1724-4e52-ae14-0b1a867db830/file', 'properties': {}}, 'image_service': } Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Trying to clone 3761f20e-a31d-45c5-9bf0-6b2673afe5e1 from image e7bcca4e-1724-4e52-ae14-0b1a867db830 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e7bcca4e-1724-4e52-ae14-0b1a867db830', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 19 00:03:19 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Image download 0.00 MB at 0.00 MB/s Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a65918a-45fe-4649-b662-c11cff9b1773]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:19 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce" returned: 0 in 0.458s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:19 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 1G Sep 19 00:03:19 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:19 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD Sep 19 00:03:19 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:19 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:19 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:19 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD Sep 19 00:03:19 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 1G" returned: 0 in 0.485s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33a4018-a9af-4225-9938-5d39fb1457ce -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:19 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33a4018-a9af-4225-9938-5d39fb1457ce -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 Sep 19 00:03:19 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "cinder-8c021fcf-c049-41f8-befc-13e9d45e08ff-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-8c021fcf-c049-41f8-befc-13e9d45e08ff-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "cinder-quobyte-8c021fcf-c049-41f8-befc-13e9d45e08ff" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-quobyte-8c021fcf-c049-41f8-befc-13e9d45e08ff" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:20 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b07fb37-e791-4cf0-82fa-6aa77ad5e6b1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD" returned: 1 in 0.447s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Temporary image e7bcca4e-1724-4e52-ae14-0b1a867db830 is fetched for user 1912e748fe39433c81e95e1a3a9c67c7. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Flow 'volume_create_manager' (f7766bc9-2722-499a-8885-8a0ad157313e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570688b2-731f-4189-a604-cc25589ab9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:20 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570688b2-731f-4189-a604-cc25589ab9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1213939578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460d2d92-f8ce-4824-8863-56ac63362017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2e519a144b4bf88cbe35e86e0cd13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:20Z,use_quota=True,user_id='f5bc51d0aad34f29a915048f91482862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f305d5c-f911-44f9-b340-22ed21ae6cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f305d5c-f911-44f9-b340-22ed21ae6cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d35e4fb-473c-482e-b4cb-9b799a7dab24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:20 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff Sep 19 00:03:20 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d35e4fb-473c-482e-b4cb-9b799a7dab24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '460d2d92-f8ce-4824-8863-56ac63362017', 'volume_name': 'volume-460d2d92-f8ce-4824-8863-56ac63362017', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50eab241-8146-435e-860f-730e34be5aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50eab241-8146-435e-860f-730e34be5aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb612d0-2f68-4d38-9ef9-29735685d899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume 460d2d92-f8ce-4824-8863-56ac63362017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-460d2d92-f8ce-4824-8863-56ac63362017', 'volume_size': 1} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33a4018-a9af-4225-9938-5d39fb1457ce -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98" returned: 0 in 0.450s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:20 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 is being set with open permissions: ugo+rw Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7238f7-4125-4ddc-8bff-e835107fc898]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:20 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 Sep 19 00:03:20 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:20 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD Sep 19 00:03:20 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:20 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff" returned: 0 in 0.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:20 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff Sep 19 00:03:20 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:20 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98" returned: 0 in 0.291s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:20 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.info Sep 19 00:03:20 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:20 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:20 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD Sep 19 00:03:20 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:20 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8c021fcf-c049-41f8-befc-13e9d45e08ff" returned: 0 in 0.284s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-quobyte-8c021fcf-c049-41f8-befc-13e9d45e08ff" released by "delete_volume" :: held 0.790s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:20 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.info" returned: 0 in 0.274s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:20 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.info is being set with open permissions: ugo+rw Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:20 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.info Sep 19 00:03:20 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Created reservations ['a2e8b8bb-4fcb-4287-9227-07f4ba73c5f6', '48a15a05-8b24-43e1-90c5-d7084f8fdf55', '53c07cef-3f93-4647-8e85-447e386d6faa', 'c096d271-7f73-4237-9d75-9d8026e45636'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:20 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:20 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:20 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "cinder-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:21 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.info" returned: 0 in 0.295s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1213939578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460d2d92-f8ce-4824-8863-56ac63362017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2e519a144b4bf88cbe35e86e0cd13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:20Z,use_quota=True,user_id='f5bc51d0aad34f29a915048f91482862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Creating volume 460d2d92-f8ce-4824-8863-56ac63362017 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:21 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "cinder-quobyte-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:21 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 1073741824 Sep 19 00:03:21 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-quobyte-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" acquired by "delete_volume" :: waited 0.048s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-73b5dfea-49f2-40ef-87fa-f1b37fd5ff72 tempest-ProjectMemberTests-883983225 None] Create snapshot completed successfully Sep 19 00:03:21 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.342s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fee7d3-2876-44e3-a88c-1f72f86e1be2]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Deleted volume successfully. Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-322918fc-a5a7-4dd0-b2f2-7f771691c0cf tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-8c021fcf-c049-41f8-befc-13e9d45e08ff-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:21 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:21 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:21 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 Sep 19 00:03:21 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:21 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.288s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 29 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 19 00:03:21 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 1073741824" returned: 0 in 0.510s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:21 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" returned: 0 in 0.438s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:21 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 Sep 19 00:03:21 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:21 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7 Sep 19 00:03:21 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-6202b067-ccca-4453-adad-cd8462e80a98-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Lock "cinder-6202b067-ccca-4453-adad-cd8462e80a98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-c33a4018-a9af-4225-9938-5d39fb1457ce" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-c33a4018-a9af-4225-9938-5d39fb1457ce" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-6202b067-ccca-4453-adad-cd8462e80a98" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-6202b067-ccca-4453-adad-cd8462e80a98" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Deleting offline snapshot 6202b067-ccca-4453-adad-cd8462e80a98 of volume c33a4018-a9af-4225-9938-5d39fb1457ce {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] snapshot_file for this snap is: volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d18326a-79d0-4661-8c03-413cd1b11ff7]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:21 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" returned: 0 in 0.268s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:21 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017" returned: 0 in 0.301s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.039s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3761f20e-a31d-45c5-9bf0-6b2673afe5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='606b768e0be34ad2ba48e9d0755b1f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:18Z,use_quota=True,user_id='1912e748fe39433c81e95e1a3a9c67c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Creating volume 3761f20e-a31d-45c5-9bf0-6b2673afe5e1 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:21 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-quobyte-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7" released by "delete_volume" :: held 0.800s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:21 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 1073741824 Sep 19 00:03:21 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb612d0-2f68-4d38-9ef9-29735685d899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-460d2d92-f8ce-4824-8863-56ac63362017', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f4fa92-7bcd-4172-8eca-9fc89e1cd919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume volume-460d2d92-f8ce-4824-8863-56ac63362017 (460d2d92-f8ce-4824-8863-56ac63362017): created successfully Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f4fa92-7bcd-4172-8eca-9fc89e1cd919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Flow 'volume_create_manager' (f7766bc9-2722-499a-8885-8a0ad157313e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:22 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 Sep 19 00:03:22 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7119b558-6660-48b0-b460-890ebaf4e520 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created volume successfully. Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Created reservations ['dfa163fa-9b5f-4b7c-801b-caeb29adf551', 'dd4bebb6-f4a9-48ef-8912-6430bd12e8a9', '719b8cb9-6f0d-42d0-88e4-884e966d4582', '0f4db078-6805-491d-bbc6-104555255240'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:22 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:22 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:22 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98" returned: 0 in 0.426s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c33a4018-a9af-4225-9938-5d39fb1457ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca2c4f5-826d-4bee-a0ac-f2e65ed726e4]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:22 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 1073741824" returned: 0 in 0.447s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:22 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Deleted volume successfully. Sep 19 00:03:22 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 Sep 19 00:03:22 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa6bd2e0-35a2-430e-ad88-8cd840c1c7ce tempest-VolumeDependencyTests-2080965332 None] Lock "cinder-9ff3d920-39a8-4d65-b5e2-5e8ef80ef3e7-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:22 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce Sep 19 00:03:22 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:22 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1" returned: 0 in 0.272s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Attempting download of e7bcca4e-1724-4e52-ae14-0b1a867db830 ((None, [{'url': 'file:///opt/stack/data/glance/images/e7bcca4e-1724-4e52-ae14-0b1a867db830', 'metadata': {}}])) to volume 3761f20e-a31d-45c5-9bf0-6b2673afe5e1. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 19 00:03:22 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce" returned: 0 in 0.415s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aa6fab-1dd9-442a-a803-6c600018938c]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7bcca4e-1724-4e52-ae14-0b1a867db830_2igmwcjn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:22 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 Sep 19 00:03:22 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:22 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7bcca4e-1724-4e52-ae14-0b1a867db830_2igmwcjn Sep 19 00:03:22 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:23 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98" returned: 0 in 0.396s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:23 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e7bcca4e-1724-4e52-ae14-0b1a867db830_2igmwcjn" returned: 0 in 0.405s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7bcca4e-1724-4e52-ae14-0b1a867db830_2igmwcjn {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:23 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98 Sep 19 00:03:23 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:23 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7bcca4e-1724-4e52-ae14-0b1a867db830_2igmwcjn Sep 19 00:03:23 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Creating offline snapshot d45c846c-00be-4275-b43a-7651a4f1c4eb of volume 460d2d92-f8ce-4824-8863-56ac63362017 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59f6755-3e73-42dd-8685-1fbd1b69110d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:23 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce.6202b067-ccca-4453-adad-cd8462e80a98" returned: 0 in 0.420s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-6202b067-ccca-4453-adad-cd8462e80a98" released by "_delete_snapshot" :: held 1.793s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-c33a4018-a9af-4225-9938-5d39fb1457ce" released by "delete_snapshot" :: held 1.826s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:23 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:23 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 Sep 19 00:03:23 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7bcca4e-1724-4e52-ae14-0b1a867db830_2igmwcjn" returned: 1 in 0.489s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e7bcca4e-1724-4e52-ae14-0b1a867db830_2igmwcjn' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5916f25-3d35-4f08-b7c2-b6b69bae32f5]: (4, 'raw') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Created reservations ['8b33c86f-ae15-461f-afc9-e1f37b23de65', 'a28930eb-b5fb-4b78-8ca2-b78ea3442104', 'b5fa3189-955c-4bc2-b124-855b02f22cbf', '2064cd7f-8baf-42e4-9aa1-f44811001d84'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:23 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD Sep 19 00:03:23 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Delete snapshot completed successfully. Sep 19 00:03:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2e6376f5-0966-4558-921c-b783493828be tempest-ProjectMemberTests-883983225 None] Lock "cinder-6202b067-ccca-4453-adad-cd8462e80a98-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:24 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017" returned: 0 in 0.487s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:24 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb 1G Sep 19 00:03:24 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-c33a4018-a9af-4225-9938-5d39fb1457ce-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Lock "cinder-c33a4018-a9af-4225-9938-5d39fb1457ce-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:24 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-c33a4018-a9af-4225-9938-5d39fb1457ce" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-c33a4018-a9af-4225-9938-5d39fb1457ce" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:24 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD Sep 19 00:03:24 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e306b9f-537a-4213-b0df-cd721c7f775b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:24 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce Sep 19 00:03:24 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:24 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD" returned: 1 in 0.452s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] e7bcca4e-1724-4e52-ae14-0b1a867db830 was raw, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:24 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 Sep 19 00:03:24 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:24 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb 1G" returned: 0 in 0.637s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-460d2d92-f8ce-4824-8863-56ac63362017 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:24 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-460d2d92-f8ce-4824-8863-56ac63362017 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb Sep 19 00:03:24 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:24 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce" returned: 0 in 0.497s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:24 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce Sep 19 00:03:24 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:25 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-460d2d92-f8ce-4824-8863-56ac63362017 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb" returned: 0 in 0.380s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:25 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb is being set with open permissions: ugo+rw Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:25 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb Sep 19 00:03:25 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:25 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c33a4018-a9af-4225-9938-5d39fb1457ce" returned: 0 in 0.324s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-c33a4018-a9af-4225-9938-5d39fb1457ce" released by "delete_volume" :: held 0.931s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:25 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1" returned: 0 in 0.624s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e7bcca4e-1724-4e52-ae14-0b1a867db830_1on7xeqwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 19 00:03:25 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Converted 0.00 MB image at 0.00 MB/s Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Created reservations ['b3523e38-9a20-41d5-8a4f-cf6d9cd9769f', 'd86fa657-7262-4929-8a75-11e6158bc69b', 'f07a777c-3f42-4f0e-a3d5-2c4199d3ac7f', 'c8fe6dc8-aded-4f7c-8bf5-e2218c483b7b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:25 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 1G Sep 19 00:03:25 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:25 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb" returned: 0 in 0.320s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:25 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:25 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:25 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.info Sep 19 00:03:25 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:25 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:25 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.299s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 1G" returned: 0 in 0.425s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Downloaded image e7bcca4e-1724-4e52-ae14-0b1a867db830 ((None, [{'url': 'file:///opt/stack/data/glance/images/e7bcca4e-1724-4e52-ae14-0b1a867db830', 'metadata': {}}])) to volume 3761f20e-a31d-45c5-9bf0-6b2673afe5e1 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Temporary image e7bcca4e-1724-4e52-ae14-0b1a867db830 for user 1912e748fe39433c81e95e1a3a9c67c7 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Marking volume 3761f20e-a31d-45c5-9bf0-6b2673afe5e1 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 19 00:03:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Deleted volume successfully. Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Copying metadata from image e7bcca4e-1724-4e52-ae14-0b1a867db830 to 3761f20e-a31d-45c5-9bf0-6b2673afe5e1. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Creating volume glance metadata for volume 3761f20e-a31d-45c5-9bf0-6b2673afe5e1 backed by image e7bcca4e-1724-4e52-ae14-0b1a867db830 with: {'image_id': 'e7bcca4e-1724-4e52-ae14-0b1a867db830', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '61dac7d036a1825c8cfc3be4c5c7f398', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a063177-5ae2-486b-9114-1d9c0db8e817 tempest-ProjectMemberTests-883983225 None] Lock "cinder-c33a4018-a9af-4225-9938-5d39fb1457ce-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:25 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.info" returned: 0 in 0.320s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:25 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.info is being set with open permissions: ugo+rw Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:25 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.info Sep 19 00:03:25 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c937e335-bc2d-48da-9f11-ea9ccb777c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1', 'volume_size': 1, 'image_id': 'e7bcca4e-1724-4e52-ae14-0b1a867db830', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e7bcca4e-1724-4e52-ae14-0b1a867db830', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '61dac7d036a1825c8cfc3be4c5c7f398', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '606b768e0be34ad2ba48e9d0755b1f8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '57fb350ce7574e596f7b8aea8cabc9d4a2698f7f9029b1fde8e38ba847a610ea0d174a2f1b4e15ade91bc12f676a00605eb1431dc6cf8482f5b351e0f77633e4', 'id': 'e7bcca4e-1724-4e52-ae14-0b1a867db830', 'created_at': datetime.datetime(2026, 9, 18, 22, 3, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 18, 22, 3, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e7bcca4e-1724-4e52-ae14-0b1a867db830/file', 'properties': {}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff64d56-4c22-4d57-a6c7-5485b64c7181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Volume volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 (3761f20e-a31d-45c5-9bf0-6b2673afe5e1): created successfully Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff64d56-4c22-4d57-a6c7-5485b64c7181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Flow 'volume_create_manager' (7f52e702-d019-4ec7-91ef-83510007ae93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d9c3cac1-6b4a-4a24-8661-38def4ebc029 tempest-VolumeImageDependencyTests-968630306 None] Created volume successfully. Sep 19 00:03:25 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.info" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d3e8d483-df43-45d4-90ed-34a5230c6d36 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Create snapshot completed successfully Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (e4f33328-097b-4193-9294-3d05286b5ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c93cb0-5c2a-4618-9abb-941dc7a81b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c93cb0-5c2a-4618-9abb-941dc7a81b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1092101902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab995cc8-4063-436d-9921-6decb56fb8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:27Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4c5c8c-21bf-4b77-9ee2-386faa268d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4c5c8c-21bf-4b77-9ee2-386faa268d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d97a151-361a-48f2-8652-8a7654162d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d97a151-361a-48f2-8652-8a7654162d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab995cc8-4063-436d-9921-6decb56fb8e4', 'volume_name': 'volume-ab995cc8-4063-436d-9921-6decb56fb8e4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e855d6-d006-4517-8851-e163757b71ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e855d6-d006-4517-8851-e163757b71ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee96e464-aab6-48ea-ad92-1c50c843928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Volume ab995cc8-4063-436d-9921-6decb56fb8e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab995cc8-4063-436d-9921-6decb56fb8e4', 'volume_size': 1} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1092101902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab995cc8-4063-436d-9921-6decb56fb8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:27Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Creating volume ab995cc8-4063-436d-9921-6decb56fb8e4 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:26 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:27 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 1073741824 Sep 19 00:03:27 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Acquiring lock "cinder-3761f20e-a31d-45c5-9bf0-6b2673afe5e1-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Lock "cinder-3761f20e-a31d-45c5-9bf0-6b2673afe5e1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Acquiring lock "cinder-quobyte-3761f20e-a31d-45c5-9bf0-6b2673afe5e1" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Lock "cinder-quobyte-3761f20e-a31d-45c5-9bf0-6b2673afe5e1" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c895ddd6-74c9-45e0-a4da-b26c68b29b05]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Flow 'volume_create_manager' (8e3ffa56-dbdf-468e-a5ce-967258ee6711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6830a7c6-2da8-4dea-b9c8-c24f8fe54a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6830a7c6-2da8-4dea-b9c8-c24f8fe54a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-876482761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5362e9-5e79-4fcb-b96f-696c483f6954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2e519a144b4bf88cbe35e86e0cd13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:27Z,use_quota=True,user_id='f5bc51d0aad34f29a915048f91482862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bdcd71-1ebc-4fc0-8927-fd31ff5e0000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7bdcd71-1ebc-4fc0-8927-fd31ff5e0000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabd03bd-c4ff-42ab-ba9c-30d6d8d43c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabd03bd-c4ff-42ab-ba9c-30d6d8d43c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5362e9-5e79-4fcb-b96f-696c483f6954', 'volume_name': 'volume-dc5362e9-5e79-4fcb-b96f-696c483f6954', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a01fae2-9f85-41dc-b67a-7efd72e07ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a01fae2-9f85-41dc-b67a-7efd72e07ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f77ac83-5e2d-46e8-8d38-52625afd5b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:27 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume dc5362e9-5e79-4fcb-b96f-696c483f6954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5362e9-5e79-4fcb-b96f-696c483f6954', 'volume_size': 1} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:27 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 Sep 19 00:03:27 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:27 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 1073741824" returned: 0 in 0.664s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Flow 'volume_create_manager' (a643aaab-90cf-47d8-8bae-52ed9174f54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3346d0-37dd-44a9-98c5-ca48958508e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3346d0-37dd-44a9-98c5-ca48958508e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-86264471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41ab541-7e71-43ea-a3b7-4503ef9be4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2e519a144b4bf88cbe35e86e0cd13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:28Z,use_quota=True,user_id='f5bc51d0aad34f29a915048f91482862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc4dac8-d3c7-4d9d-be44-49d927a076a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:27 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 Sep 19 00:03:27 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc4dac8-d3c7-4d9d-be44-49d927a076a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fc262d-b9e9-4734-bf34-fca65f8ad178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fc262d-b9e9-4734-bf34-fca65f8ad178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41ab541-7e71-43ea-a3b7-4503ef9be4e9', 'volume_name': 'volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf151e7-97bd-45a3-8700-189e6c9dd11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf151e7-97bd-45a3-8700-189e6c9dd11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943831fe-ca0e-4d38-b633-4b2c2fd6c688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:27 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume c41ab541-7e71-43ea-a3b7-4503ef9be4e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9', 'volume_size': 1} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:27 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1" returned: 0 in 0.644s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:27 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1 Sep 19 00:03:27 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:28 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4" returned: 0 in 0.313s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-876482761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5362e9-5e79-4fcb-b96f-696c483f6954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2e519a144b4bf88cbe35e86e0cd13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:27Z,use_quota=True,user_id='f5bc51d0aad34f29a915048f91482862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Creating volume dc5362e9-5e79-4fcb-b96f-696c483f6954 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:28 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc5362e9-5e79-4fcb-b96f-696c483f6954 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee96e464-aab6-48ea-ad92-1c50c843928c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab995cc8-4063-436d-9921-6decb56fb8e4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:28 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc5362e9-5e79-4fcb-b96f-696c483f6954 1073741824 Sep 19 00:03:28 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f834ee4a-99a5-4e2a-a96a-49a296ae4b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Volume volume-ab995cc8-4063-436d-9921-6decb56fb8e4 (ab995cc8-4063-436d-9921-6decb56fb8e4): created successfully Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f834ee4a-99a5-4e2a-a96a-49a296ae4b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (e4f33328-097b-4193-9294-3d05286b5ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-11f0272d-40a0-44a9-8255-6a9572a63063 tempest-ProjectMemberTests-883983225 None] Created volume successfully. Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Flow 'volume_create_manager' (42c88e9a-89a3-49d8-8540-068731b19daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1da0c56-19b5-40e6-bcca-7fc5a09e72db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:28 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-3761f20e-a31d-45c5-9bf0-6b2673afe5e1" returned: 0 in 0.411s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1da0c56-19b5-40e6-bcca-7fc5a09e72db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-868028891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae4b9f6-76d3-451b-9b27-3fd5ba63e350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2e519a144b4bf88cbe35e86e0cd13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:28Z,use_quota=True,user_id='f5bc51d0aad34f29a915048f91482862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05c4f74-5608-4435-b04a-da7bc44a31a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05c4f74-5608-4435-b04a-da7bc44a31a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77548548-04b6-41f1-8864-ed9b58094f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77548548-04b6-41f1-8864-ed9b58094f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae4b9f6-76d3-451b-9b27-3fd5ba63e350', 'volume_name': 'volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6c94f3-a1c9-41ce-817b-075788b799d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6c94f3-a1c9-41ce-817b-075788b799d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c05544-8a93-4f0f-95c5-05543963dcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume 6ae4b9f6-76d3-451b-9b27-3fd5ba63e350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350', 'volume_size': 1} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Lock "cinder-quobyte-3761f20e-a31d-45c5-9bf0-6b2673afe5e1" released by "delete_volume" :: held 1.224s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Created reservations ['083cb217-0ff6-4345-bb01-7730a84ff526', 'f1961e44-b023-4834-9fd5-2fbeb0cd0718', '9013e11a-1ca1-477a-bac0-1904f0cace5a', '944a2247-cc3b-4298-a0c9-286862376245'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:28 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:28 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:28 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Flow 'volume_create_manager' (48222d89-b107-4d38-bf65-7cb7597c467d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e1f3b2-3b2b-4763-a821-6a2b2559bbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc5362e9-5e79-4fcb-b96f-696c483f6954 1073741824" returned: 0 in 0.712s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e1f3b2-3b2b-4763-a821-6a2b2559bbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1565286269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd56c24-64af-41e2-a695-3b7840c98781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2e519a144b4bf88cbe35e86e0cd13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:29Z,use_quota=True,user_id='f5bc51d0aad34f29a915048f91482862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c604efd-2e1e-45cd-8d31-8a8f8c2fa723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c604efd-2e1e-45cd-8d31-8a8f8c2fa723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac103cca-66c3-4c1f-98b1-e0c58283d3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac103cca-66c3-4c1f-98b1-e0c58283d3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd56c24-64af-41e2-a695-3b7840c98781', 'volume_name': 'volume-2dd56c24-64af-41e2-a695-3b7840c98781', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e00ef7-4fb7-4e48-a248-ac6e52c6a759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e00ef7-4fb7-4e48-a248-ac6e52c6a759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c48a965-65ba-485c-bc04-b4b6f1f0e4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume 2dd56c24-64af-41e2-a695-3b7840c98781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd56c24-64af-41e2-a695-3b7840c98781', 'volume_size': 1} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc5362e9-5e79-4fcb-b96f-696c483f6954 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:28 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc5362e9-5e79-4fcb-b96f-696c483f6954 Sep 19 00:03:28 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:29 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Deleted volume successfully. Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f27844e8-04e1-430a-a005-14f947e756ee tempest-VolumeImageDependencyTests-968630306 None] Lock "cinder-3761f20e-a31d-45c5-9bf0-6b2673afe5e1-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Flow 'volume_create_manager' (2fa0335d-4137-4178-8bc5-9889ed81d51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2f193f-03f7-44df-9884-4e2d43f9a1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:29 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc5362e9-5e79-4fcb-b96f-696c483f6954" returned: 0 in 0.334s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.395s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-86264471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41ab541-7e71-43ea-a3b7-4503ef9be4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2e519a144b4bf88cbe35e86e0cd13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:28Z,use_quota=True,user_id='f5bc51d0aad34f29a915048f91482862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Creating volume c41ab541-7e71-43ea-a3b7-4503ef9be4e9 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:29 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2f193f-03f7-44df-9884-4e2d43f9a1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098385025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e6711e-a2ea-4060-bced-c2e303f8b5f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2e519a144b4bf88cbe35e86e0cd13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:29Z,use_quota=True,user_id='f5bc51d0aad34f29a915048f91482862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df7a678-2132-489d-90f7-232ca4b31d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:29 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9 1073741824 Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df7a678-2132-489d-90f7-232ca4b31d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:29 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73088d7-432b-4913-ac67-1b5a4071ba4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73088d7-432b-4913-ac67-1b5a4071ba4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e6711e-a2ea-4060-bced-c2e303f8b5f1', 'volume_name': 'volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e5aa30-608e-4595-92c5-8d4aa034f5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e5aa30-608e-4595-92c5-8d4aa034f5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3294c2b9-cf27-450c-ab49-826356e36536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume 89e6711e-a2ea-4060-bced-c2e303f8b5f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1', 'volume_size': 1} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f77ac83-5e2d-46e8-8d38-52625afd5b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5362e9-5e79-4fcb-b96f-696c483f6954', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d7a7ad-1aa0-402e-89f3-146ce8b67d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume volume-dc5362e9-5e79-4fcb-b96f-696c483f6954 (dc5362e9-5e79-4fcb-b96f-696c483f6954): created successfully Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d7a7ad-1aa0-402e-89f3-146ce8b67d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Flow 'volume_create_manager' (8e3ffa56-dbdf-468e-a5ce-967258ee6711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8459d624-0a3c-4a82-95d2-00980beaf9c4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created volume successfully. Sep 19 00:03:29 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9 1073741824" returned: 0 in 0.564s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:29 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9 Sep 19 00:03:29 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:30 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9" returned: 0 in 0.266s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.667s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-868028891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae4b9f6-76d3-451b-9b27-3fd5ba63e350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2e519a144b4bf88cbe35e86e0cd13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:28Z,use_quota=True,user_id='f5bc51d0aad34f29a915048f91482862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Creating volume 6ae4b9f6-76d3-451b-9b27-3fd5ba63e350 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:30 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943831fe-ca0e-4d38-b633-4b2c2fd6c688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89455d56-2d1d-404b-95b2-a96ee367ee8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:30 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350 1073741824 Sep 19 00:03:30 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:30 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9 (c41ab541-7e71-43ea-a3b7-4503ef9be4e9): created successfully Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89455d56-2d1d-404b-95b2-a96ee367ee8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Flow 'volume_create_manager' (a643aaab-90cf-47d8-8bae-52ed9174f54e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-85b9ae72-1ba7-4679-9f8a-bba1347e14a5 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created volume successfully. Sep 19 00:03:30 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350 1073741824" returned: 0 in 0.534s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:30 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350 Sep 19 00:03:30 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:30 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.125s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1565286269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd56c24-64af-41e2-a695-3b7840c98781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2e519a144b4bf88cbe35e86e0cd13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:29Z,use_quota=True,user_id='f5bc51d0aad34f29a915048f91482862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Creating volume 2dd56c24-64af-41e2-a695-3b7840c98781 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:30 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2dd56c24-64af-41e2-a695-3b7840c98781 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:31 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2dd56c24-64af-41e2-a695-3b7840c98781 1073741824 Sep 19 00:03:31 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c05544-8a93-4f0f-95c5-05543963dcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a9ce57-c959-4ca1-9f0e-44b26bb9a2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:31 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350 (6ae4b9f6-76d3-451b-9b27-3fd5ba63e350): created successfully Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a9ce57-c959-4ca1-9f0e-44b26bb9a2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Flow 'volume_create_manager' (42c88e9a-89a3-49d8-8540-068731b19daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-90a66517-0c12-4b60-9039-e64e82d53b8e tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created volume successfully. Sep 19 00:03:31 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2dd56c24-64af-41e2-a695-3b7840c98781 1073741824" returned: 0 in 0.610s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2dd56c24-64af-41e2-a695-3b7840c98781 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:31 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2dd56c24-64af-41e2-a695-3b7840c98781 Sep 19 00:03:31 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:31 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2dd56c24-64af-41e2-a695-3b7840c98781" returned: 0 in 0.274s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.587s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098385025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e6711e-a2ea-4060-bced-c2e303f8b5f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2e519a144b4bf88cbe35e86e0cd13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:29Z,use_quota=True,user_id='f5bc51d0aad34f29a915048f91482862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Creating volume 89e6711e-a2ea-4060-bced-c2e303f8b5f1 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:31 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c48a965-65ba-485c-bc04-b4b6f1f0e4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd56c24-64af-41e2-a695-3b7840c98781', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:31 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1 1073741824 Sep 19 00:03:31 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41dcc72f-046f-4bd4-809f-b37f26e54346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:31 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume volume-2dd56c24-64af-41e2-a695-3b7840c98781 (2dd56c24-64af-41e2-a695-3b7840c98781): created successfully Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41dcc72f-046f-4bd4-809f-b37f26e54346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Flow 'volume_create_manager' (48222d89-b107-4d38-bf65-7cb7597c467d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-66ce6401-a165-47b3-a343-1a0cd1f45896 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created volume successfully. Sep 19 00:03:32 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1 1073741824" returned: 0 in 0.548s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:32 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1 Sep 19 00:03:32 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:32 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1" returned: 0 in 0.278s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.416s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3294c2b9-cf27-450c-ab49-826356e36536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4007a13-f6d5-42f6-9071-b76691551280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] Creating offline snapshot e91de18f-bfb3-43e1-86b4-90c4f243cbe8 of volume ab995cc8-4063-436d-9921-6decb56fb8e4 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:03:32 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Volume volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1 (89e6711e-a2ea-4060-bced-c2e303f8b5f1): created successfully Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4007a13-f6d5-42f6-9071-b76691551280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Flow 'volume_create_manager' (2fa0335d-4137-4178-8bc5-9889ed81d51a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77fc4e-ba77-46ad-947b-653e6577bd85]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b57a2a7d-5ece-48e7-ab5f-0d8f706216f2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created volume successfully. Sep 19 00:03:33 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 Sep 19 00:03:33 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:33 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4" returned: 0 in 0.414s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:33 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 1G Sep 19 00:03:33 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca9083ea-bfc1-429e-84e3-967901aff427 tempest-ProjectAdminTests-1607235301 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6891326904297, 'free_capacity_gb': 1775.6891326904297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85963) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 19 00:03:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-89e6711e-a2ea-4060-bced-c2e303f8b5f1-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-89e6711e-a2ea-4060-bced-c2e303f8b5f1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-quobyte-89e6711e-a2ea-4060-bced-c2e303f8b5f1" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-89e6711e-a2ea-4060-bced-c2e303f8b5f1" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:33 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[70011edb-daf0-4d75-9819-b4f5ea661235]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:33 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 1G" returned: 0 in 0.567s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab995cc8-4063-436d-9921-6decb56fb8e4 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:33 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab995cc8-4063-436d-9921-6decb56fb8e4 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 Sep 19 00:03:33 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:34 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1 Sep 19 00:03:34 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Flow 'volume_create_manager' (91773029-e977-49a7-8e76-739c96cb3f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801fd211-e85c-47f8-921a-82f460fdb3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801fd211-e85c-47f8-921a-82f460fdb3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072093281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4f317d-80bb-4d8e-b600-0061a81b775c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c17acac06e342d892261e5fe98c16a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:34Z,use_quota=True,user_id='5851a32bb5c04787b329a9e874b8db68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608be902-e9c6-4bb6-8a93-88676bf653b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608be902-e9c6-4bb6-8a93-88676bf653b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b23d8a-cbe3-4af5-80df-200bbc0245f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b23d8a-cbe3-4af5-80df-200bbc0245f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4f317d-80bb-4d8e-b600-0061a81b775c', 'volume_name': 'volume-fd4f317d-80bb-4d8e-b600-0061a81b775c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d60ca2f-58bf-4d18-a07a-2122d52572e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d60ca2f-58bf-4d18-a07a-2122d52572e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f614270-79be-4007-b959-952ba50ae3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:34 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Volume fd4f317d-80bb-4d8e-b600-0061a81b775c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4f317d-80bb-4d8e-b600-0061a81b775c', 'volume_size': 1} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:34 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab995cc8-4063-436d-9921-6decb56fb8e4 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8" returned: 0 in 0.393s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:34 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 is being set with open permissions: ugo+rw Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:34 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 Sep 19 00:03:34 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:34 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1" returned: 0 in 0.498s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:34 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1 Sep 19 00:03:34 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:34 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8" returned: 0 in 0.300s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:34 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-89e6711e-a2ea-4060-bced-c2e303f8b5f1" returned: 0 in 0.275s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:34 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.info Sep 19 00:03:34 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-89e6711e-a2ea-4060-bced-c2e303f8b5f1" released by "delete_volume" :: held 0.831s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created reservations ['5d48035a-d8e4-4b8c-bd48-f7c6b791fe12', '7393df67-71e4-4c14-9d54-644458fb4314', '0d899890-0e21-4c6d-8009-a04ff6292f49', '888af209-5150-4c7c-8d1b-43e376e9003e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:34 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:34 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:34 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.info" returned: 0 in 0.310s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:34 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.info is being set with open permissions: ugo+rw Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-2dd56c24-64af-41e2-a695-3b7840c98781-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:34 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.info Sep 19 00:03:34 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-2dd56c24-64af-41e2-a695-3b7840c98781-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-quobyte-2dd56c24-64af-41e2-a695-3b7840c98781" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-2dd56c24-64af-41e2-a695-3b7840c98781" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[37507331-26ec-464d-ac53-543db4404c6d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2dd56c24-64af-41e2-a695-3b7840c98781 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:35 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Deleted volume successfully. Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-93496003-85a8-492e-8aef-24ca8eda95b2 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-89e6711e-a2ea-4060-bced-c2e303f8b5f1-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:35 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2dd56c24-64af-41e2-a695-3b7840c98781 Sep 19 00:03:35 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:35 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.info" returned: 0 in 0.331s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.023s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072093281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4f317d-80bb-4d8e-b600-0061a81b775c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c17acac06e342d892261e5fe98c16a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:34Z,use_quota=True,user_id='5851a32bb5c04787b329a9e874b8db68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Creating volume fd4f317d-80bb-4d8e-b600-0061a81b775c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:35 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7f7ee4ee-05b0-48cb-9155-a410b169fb81 tempest-ProjectMemberTests-883983225 None] Create snapshot completed successfully Sep 19 00:03:35 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c 1073741824 Sep 19 00:03:35 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:35 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2dd56c24-64af-41e2-a695-3b7840c98781" returned: 0 in 0.430s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2dd56c24-64af-41e2-a695-3b7840c98781 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:35 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2dd56c24-64af-41e2-a695-3b7840c98781 Sep 19 00:03:35 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-e91de18f-bfb3-43e1-86b4-90c4f243cbe8-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Lock "cinder-e91de18f-bfb3-43e1-86b4-90c4f243cbe8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-ab995cc8-4063-436d-9921-6decb56fb8e4" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-ab995cc8-4063-436d-9921-6decb56fb8e4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-e91de18f-bfb3-43e1-86b4-90c4f243cbe8" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-e91de18f-bfb3-43e1-86b4-90c4f243cbe8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Deleting offline snapshot e91de18f-bfb3-43e1-86b4-90c4f243cbe8 of volume ab995cc8-4063-436d-9921-6decb56fb8e4 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] snapshot_file for this snap is: volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:03:35 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-2dd56c24-64af-41e2-a695-3b7840c98781" returned: 0 in 0.303s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4c56a4-458a-4b38-a517-1db4b7c20c1e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-2dd56c24-64af-41e2-a695-3b7840c98781" released by "delete_volume" :: held 0.796s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:35 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c 1073741824" returned: 0 in 0.619s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created reservations ['9b6eca29-b5e6-4d64-ac67-7cae6799a3e4', '845df65e-d104-45b1-87b2-43936c9e8cdd', 'ae276bb3-c96f-40ce-b282-e5153e185c92', 'e5608008-3cb8-4559-b076-730fd85aedca'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:35 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 Sep 19 00:03:35 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:35 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c Sep 19 00:03:35 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:36 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:36 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:36 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-quobyte-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c" returned: 0 in 0.330s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f614270-79be-4007-b959-952ba50ae3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4f317d-80bb-4d8e-b600-0061a81b775c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea51b6a4-7a49-42af-b00c-969e5d2dbc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350" acquired by "delete_volume" :: waited 0.056s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:36 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8" returned: 0 in 0.527s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab995cc8-4063-436d-9921-6decb56fb8e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[33993415-88bc-49eb-98ed-ef7e42e4ae54]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a281c14-25b8-4b1e-8e12-2baf70afb8c2]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:36 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Volume volume-fd4f317d-80bb-4d8e-b600-0061a81b775c (fd4f317d-80bb-4d8e-b600-0061a81b775c): created successfully Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea51b6a4-7a49-42af-b00c-969e5d2dbc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Flow 'volume_create_manager' (91773029-e977-49a7-8e76-739c96cb3f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.412s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Deleted volume successfully. Sep 19 00:03:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1537d988-a7a9-4d7c-9771-ceeb06844278 tempest-ProjectReaderTests-902715026 None] Created volume successfully. Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9654aaf-cc89-41fd-a627-b63dc039223d tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-2dd56c24-64af-41e2-a695-3b7840c98781-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:36 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350 Sep 19 00:03:36 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:36 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 Sep 19 00:03:36 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:36 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4" returned: 0 in 0.416s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:36 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350" returned: 0 in 0.446s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:36 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 Sep 19 00:03:36 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:36 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350 Sep 19 00:03:36 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:37 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350" returned: 0 in 0.260s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350" released by "delete_volume" :: held 0.779s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created reservations ['30d116a5-04d7-42c6-a812-6cbca7a745d3', '3842366a-1ef3-4d99-8c55-04d994a537d5', '7b845e50-98de-42a0-8786-8ea6887a423b', 'e9a024a7-7af2-40d8-af8f-5780277589c7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:37 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8" returned: 0 in 0.405s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:37 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8 Sep 19 00:03:37 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:37 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:37 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-c41ab541-7e71-43ea-a3b7-4503ef9be4e9-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-c41ab541-7e71-43ea-a3b7-4503ef9be4e9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-quobyte-c41ab541-7e71-43ea-a3b7-4503ef9be4e9" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-c41ab541-7e71-43ea-a3b7-4503ef9be4e9" acquired by "delete_volume" :: waited 0.053s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6e34b5-02f8-42ce-8550-860daa92e6c6]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:37 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4.e91de18f-bfb3-43e1-86b4-90c4f243cbe8" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:37 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.424s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-e91de18f-bfb3-43e1-86b4-90c4f243cbe8" released by "_delete_snapshot" :: held 1.914s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-ab995cc8-4063-436d-9921-6decb56fb8e4" released by "delete_snapshot" :: held 1.959s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Deleted volume successfully. Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] Creating offline snapshot 52ab7920-5af0-46e5-bca7-43596210959a of volume fd4f317d-80bb-4d8e-b600-0061a81b775c {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b21f30ce-451b-4ac6-88f4-d2bfd7c81440 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-6ae4b9f6-76d3-451b-9b27-3fd5ba63e350-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f53c5f-307f-4f5f-9f32-ef28594d2967]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:37 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9 Sep 19 00:03:37 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Created reservations ['194d97c9-a2dd-412c-bd05-04841093071f', '0308e097-b2ca-4947-80aa-a977b04f29f5', '63d9e37d-f011-45e6-b440-1e78b41c26b0', 'acb2596b-92c4-4e16-82ed-fcba1c1deaf1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Delete snapshot completed successfully. Sep 19 00:03:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fcca1916-9f2d-44fb-ac80-02d0876c44f8 tempest-ProjectMemberTests-883983225 None] Lock "cinder-e91de18f-bfb3-43e1-86b4-90c4f243cbe8-delete_snapshot" released by "delete_snapshot" :: held 2.168s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:37 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c Sep 19 00:03:37 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:38 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9" returned: 0 in 0.481s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:38 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9 Sep 19 00:03:38 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:38 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c" returned: 0 in 0.457s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:38 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a 1G Sep 19 00:03:38 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:38 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c41ab541-7e71-43ea-a3b7-4503ef9be4e9" returned: 0 in 0.314s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-c41ab541-7e71-43ea-a3b7-4503ef9be4e9" released by "delete_volume" :: held 0.860s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created reservations ['243f4fd4-1f0d-40d9-9b8a-9d6538230c2a', 'c53b471b-c54b-4efa-9cd9-0eda4d642f78', 'ab1a0f46-f072-41c0-b76d-0279ba8247eb', '3600df02-b588-4a19-9006-61a40a7a0e54'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:38 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:38 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-dc5362e9-5e79-4fcb-b96f-696c483f6954-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-dc5362e9-5e79-4fcb-b96f-696c483f6954-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:38 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a 1G" returned: 0 in 0.521s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4f317d-80bb-4d8e-b600-0061a81b775c -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:38 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4f317d-80bb-4d8e-b600-0061a81b775c -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a Sep 19 00:03:38 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-quobyte-dc5362e9-5e79-4fcb-b96f-696c483f6954" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-dc5362e9-5e79-4fcb-b96f-696c483f6954" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6342de-2a7e-475a-9f12-7bc06431c67a]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc5362e9-5e79-4fcb-b96f-696c483f6954 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:38 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.321s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Deleted volume successfully. Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-abae2ff4-de96-4d20-aa7c-c7d789a6ba06 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-c41ab541-7e71-43ea-a3b7-4503ef9be4e9-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:38 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc5362e9-5e79-4fcb-b96f-696c483f6954 Sep 19 00:03:38 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-ab995cc8-4063-436d-9921-6decb56fb8e4-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Lock "cinder-ab995cc8-4063-436d-9921-6decb56fb8e4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-ab995cc8-4063-436d-9921-6decb56fb8e4" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-ab995cc8-4063-436d-9921-6decb56fb8e4" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[82daf5a1-16be-4952-8102-cc55b2db01ff]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:39 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4f317d-80bb-4d8e-b600-0061a81b775c -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a" returned: 0 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:39 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a is being set with open permissions: ugo+rw Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:39 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a Sep 19 00:03:39 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:39 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 Sep 19 00:03:39 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:39 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc5362e9-5e79-4fcb-b96f-696c483f6954" returned: 0 in 0.406s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc5362e9-5e79-4fcb-b96f-696c483f6954 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:39 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc5362e9-5e79-4fcb-b96f-696c483f6954 Sep 19 00:03:39 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:39 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a" returned: 0 in 0.309s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:39 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.info Sep 19 00:03:39 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:39 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4" returned: 0 in 0.445s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:39 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4 Sep 19 00:03:39 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:39 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc5362e9-5e79-4fcb-b96f-696c483f6954" returned: 0 in 0.391s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-dc5362e9-5e79-4fcb-b96f-696c483f6954" released by "delete_volume" :: held 0.857s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created reservations ['6f7a0c83-af81-459a-8991-d88af4d690aa', 'e1e96c70-21a1-49cf-a314-9111420ca859', '3ed617a4-bc99-4f4f-a1e9-fc6ea0b61114', '9abb64f5-34ce-4236-9d92-a5b2fe931c6b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:39 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.info" returned: 0 in 0.336s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:39 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.info is being set with open permissions: ugo+rw Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-d45c846c-00be-4275-b43a-7651a4f1c4eb-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:39 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.info Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:39 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-d45c846c-00be-4275-b43a-7651a4f1c4eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-quobyte-460d2d92-f8ce-4824-8863-56ac63362017" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:39 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ab995cc8-4063-436d-9921-6decb56fb8e4" returned: 0 in 0.381s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:39 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:39 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-460d2d92-f8ce-4824-8863-56ac63362017" acquired by "delete_snapshot" :: waited 0.045s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-quobyte-d45c846c-00be-4275-b43a-7651a4f1c4eb" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-d45c846c-00be-4275-b43a-7651a4f1c4eb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Deleting offline snapshot d45c846c-00be-4275-b43a-7651a4f1c4eb of volume 460d2d92-f8ce-4824-8863-56ac63362017 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] snapshot_file for this snap is: volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-ab995cc8-4063-436d-9921-6decb56fb8e4" released by "delete_volume" :: held 0.954s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[964e43c4-0f85-4c85-ba5f-3d7b01112864]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Created reservations ['10472a31-3c51-4d22-b373-01d543f5c44a', '69b92ae4-227d-48dd-bf0e-b95d83c70f38', 'b537b19b-7dc7-45de-b3af-6346543e9077', '5cfb1730-e3d3-47a0-93f3-3fb95edb3390'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:40 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb Sep 19 00:03:40 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:40 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:40 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.357s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:40 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Deleted volume successfully. Sep 19 00:03:40 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.info" returned: 0 in 0.458s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.609s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-99e8832f-1fb2-49ef-99c5-55826873741b tempest-ProjectReaderTests-902715026 None] Create snapshot completed successfully Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-40f8ccbd-cd23-4b81-9ddc-8cdbac986714 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-dc5362e9-5e79-4fcb-b96f-696c483f6954-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:40 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb" returned: 0 in 0.503s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-460d2d92-f8ce-4824-8863-56ac63362017(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:03:40 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.373s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Deleted volume successfully. Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ff16c7-120e-41c9-9cd4-bfacc6841a46]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-db1902da-d66d-4649-8e84-b6feb0131483 tempest-ProjectMemberTests-883983225 None] Lock "cinder-ab995cc8-4063-436d-9921-6decb56fb8e4-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:40 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 Sep 19 00:03:40 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-52ab7920-5af0-46e5-bca7-43596210959a-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Lock "cinder-52ab7920-5af0-46e5-bca7-43596210959a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-fd4f317d-80bb-4d8e-b600-0061a81b775c" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-fd4f317d-80bb-4d8e-b600-0061a81b775c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-52ab7920-5af0-46e5-bca7-43596210959a" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-52ab7920-5af0-46e5-bca7-43596210959a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Deleting offline snapshot 52ab7920-5af0-46e5-bca7-43596210959a of volume fd4f317d-80bb-4d8e-b600-0061a81b775c {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] snapshot_file for this snap is: volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:03:41 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017" returned: 0 in 0.419s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[132cfa21-6b38-4236-8248-557c07c2ed88]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:41 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb Sep 19 00:03:41 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:41 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a Sep 19 00:03:41 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:41 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb" returned: 0 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:41 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb Sep 19 00:03:41 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:41 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a" returned: 0 in 0.402s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4f317d-80bb-4d8e-b600-0061a81b775c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d944216-f468-4406-a49c-d8ae5c403298]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:41 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c Sep 19 00:03:41 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:41 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017.d45c846c-00be-4275-b43a-7651a4f1c4eb" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-d45c846c-00be-4275-b43a-7651a4f1c4eb" released by "_delete_snapshot" :: held 1.785s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-460d2d92-f8ce-4824-8863-56ac63362017" released by "delete_snapshot" :: held 1.817s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (08ceedce-d1b3-4918-acf9-eb5dc31f384e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351451be-cb4c-46f9-ab07-8f8d4d4fbd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351451be-cb4c-46f9-ab07-8f8d4d4fbd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1349835699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee2fd55-6bca-4a6c-827c-e599aae23622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:42Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a63970-5386-4f6d-94a4-e2c86bdd18df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a63970-5386-4f6d-94a4-e2c86bdd18df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed14f659-3e8b-439d-9658-5c6ccb289533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed14f659-3e8b-439d-9658-5c6ccb289533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ee2fd55-6bca-4a6c-827c-e599aae23622', 'volume_name': 'volume-5ee2fd55-6bca-4a6c-827c-e599aae23622', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48eb1105-4143-428c-ac66-71df8a31214b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48eb1105-4143-428c-ac66-71df8a31214b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b45916-29d8-49a1-baac-7ffe8d6b45fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:41 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Volume 5ee2fd55-6bca-4a6c-827c-e599aae23622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ee2fd55-6bca-4a6c-827c-e599aae23622', 'volume_size': 1} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1349835699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee2fd55-6bca-4a6c-827c-e599aae23622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:42Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Creating volume 5ee2fd55-6bca-4a6c-827c-e599aae23622 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:41 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:41 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c" returned: 0 in 0.466s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:41 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 1073741824 Sep 19 00:03:41 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:41 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a Sep 19 00:03:41 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created reservations ['809714f4-38e8-4441-a335-795c21c670ec', '3a801bc0-48f3-4145-9daa-eede84261a20', 'e4eec962-c21a-40a2-9199-1c0cfa4770c1', 'd3dd940c-d3e3-47c2-aa3e-201c14a17b57'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Delete snapshot completed successfully. Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2ba81446-2e35-4d7a-a03c-c8ab9ba6a595 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-d45c846c-00be-4275-b43a-7651a4f1c4eb-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:42 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:42 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a Sep 19 00:03:42 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:42 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 1073741824" returned: 0 in 0.588s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:42 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 Sep 19 00:03:42 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:42 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c.52ab7920-5af0-46e5-bca7-43596210959a" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-52ab7920-5af0-46e5-bca7-43596210959a" released by "_delete_snapshot" :: held 1.742s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-fd4f317d-80bb-4d8e-b600-0061a81b775c" released by "delete_snapshot" :: held 1.769s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Created reservations ['399ac14a-da88-449c-b89a-1c441c9f7eea', '6202dff5-76aa-430c-aa62-7774de147ce3', '5112c116-dcd8-416b-9771-42eaf6d66314', '8c053f44-c1cc-473b-8dc9-52564a3becf6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:42 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Delete snapshot completed successfully. Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622" returned: 0 in 0.298s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f69d77c9-991e-4180-8238-44f2a87b8f11 tempest-ProjectReaderTests-902715026 None] Lock "cinder-52ab7920-5af0-46e5-bca7-43596210959a-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b45916-29d8-49a1-baac-7ffe8d6b45fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ee2fd55-6bca-4a6c-827c-e599aae23622', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7cc0fd5-5536-408c-8041-857fe8abce8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:42 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Volume volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 (5ee2fd55-6bca-4a6c-827c-e599aae23622): created successfully Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7cc0fd5-5536-408c-8041-857fe8abce8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (08ceedce-d1b3-4918-acf9-eb5dc31f384e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6e599ca9-9765-4964-badd-6ebf7816e874 tempest-ProjectMemberTests-883983225 None] Created volume successfully. Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-460d2d92-f8ce-4824-8863-56ac63362017-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-460d2d92-f8ce-4824-8863-56ac63362017-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-fd4f317d-80bb-4d8e-b600-0061a81b775c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "cinder-quobyte-460d2d92-f8ce-4824-8863-56ac63362017" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Lock "cinder-fd4f317d-80bb-4d8e-b600-0061a81b775c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-460d2d92-f8ce-4824-8863-56ac63362017" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1ca840-e96e-4eb2-b97c-a3c7723a4c3c]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-fd4f317d-80bb-4d8e-b600-0061a81b775c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-fd4f317d-80bb-4d8e-b600-0061a81b775c" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc2ca27-af80-4356-9247-cd5bb35927b0]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:43 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 Sep 19 00:03:43 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:43 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c Sep 19 00:03:43 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:43 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017" returned: 0 in 0.370s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:43 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017 Sep 19 00:03:43 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:43 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c" returned: 0 in 0.382s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:43 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c Sep 19 00:03:43 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:43 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-460d2d92-f8ce-4824-8863-56ac63362017" returned: 0 in 0.294s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-quobyte-460d2d92-f8ce-4824-8863-56ac63362017" released by "delete_volume" :: held 0.753s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:43 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Created reservations ['bcfd3952-bc7a-450c-a63b-1838c624fef4', '674a1526-f840-461f-b599-163b9c003475', '80d62be9-b927-40bc-8c58-9eebb8fc1829', '3a61c7af-ff4f-41f4-84f4-db1d8328c2d1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-fd4f317d-80bb-4d8e-b600-0061a81b775c" returned: 0 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-fd4f317d-80bb-4d8e-b600-0061a81b775c" released by "delete_volume" :: held 0.791s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:44 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Created reservations ['0a55811a-99a1-473d-9aee-28b2353b8de8', '68c969ae-8b1d-455d-83be-33e17c94b062', 'd4c397ca-8ecc-4e86-9677-9ba4c32da32a', 'ff1abe2a-d0cb-4206-89dd-f99e040f68a5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:44 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] Creating offline snapshot 67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 of volume 5ee2fd55-6bca-4a6c-827c-e599aae23622 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea0ef98-61ed-4e28-a95f-15e2277b83f9]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:44 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:44 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:44 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 Sep 19 00:03:44 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:44 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.400s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Deleted volume successfully. Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c5945c83-1667-4402-8af8-ce12cce506e4 tempest-CreateVolumesFromSnapshotTest-1065583173 None] Lock "cinder-460d2d92-f8ce-4824-8863-56ac63362017-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:44 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.420s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Deleted volume successfully. Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-71df873c-68e3-4b08-86d3-bb5103d953ad tempest-ProjectReaderTests-902715026 None] Lock "cinder-fd4f317d-80bb-4d8e-b600-0061a81b775c-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:44 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622" returned: 0 in 0.718s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:45 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 1G Sep 19 00:03:45 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Flow 'volume_create_manager' (c48d892b-1ff7-4f4a-bee3-186889971ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05561bca-c66f-4201-98e9-65cf28e9f1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05561bca-c66f-4201-98e9-65cf28e9f1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-738509334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211b68ae-cdeb-49fd-8997-64547f1abcdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c17acac06e342d892261e5fe98c16a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:45Z,use_quota=True,user_id='5851a32bb5c04787b329a9e874b8db68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9c9033-6b9f-47f1-82a8-2a975c055ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9c9033-6b9f-47f1-82a8-2a975c055ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118c8257-c74e-4c06-aecb-af97d785cf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118c8257-c74e-4c06-aecb-af97d785cf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211b68ae-cdeb-49fd-8997-64547f1abcdc', 'volume_name': 'volume-211b68ae-cdeb-49fd-8997-64547f1abcdc', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89dcc21-59d4-4d3f-8e8b-8cb6bcab18c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89dcc21-59d4-4d3f-8e8b-8cb6bcab18c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe15287-1c3c-4cf7-a4f4-43792dedcf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:45 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Volume 211b68ae-cdeb-49fd-8997-64547f1abcdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211b68ae-cdeb-49fd-8997-64547f1abcdc', 'volume_size': 1} Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:45 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 1G" returned: 0 in 0.539s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:45 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 Sep 19 00:03:45 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:45 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403" returned: 0 in 0.340s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:45 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 is being set with open permissions: ugo+rw Sep 19 00:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:45 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 Sep 19 00:03:45 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:46 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403" returned: 0 in 0.347s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:46 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.info Sep 19 00:03:46 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:46 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.info" returned: 0 in 0.279s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:46 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.info is being set with open permissions: ugo+rw Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:46 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.info Sep 19 00:03:46 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:46 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.info" returned: 0 in 0.276s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.655s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.531s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-738509334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211b68ae-cdeb-49fd-8997-64547f1abcdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c17acac06e342d892261e5fe98c16a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:45Z,use_quota=True,user_id='5851a32bb5c04787b329a9e874b8db68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Creating volume 211b68ae-cdeb-49fd-8997-64547f1abcdc {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:46 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d26bbbf4-0032-4201-be47-fd914cb2670b tempest-ProjectMemberTests-883983225 None] Create snapshot completed successfully Sep 19 00:03:46 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc 1073741824 Sep 19 00:03:46 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-67f694ed-c3fe-4292-8ed3-a2aaf3cd7403-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Lock "cinder-67f694ed-c3fe-4292-8ed3-a2aaf3cd7403-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-5ee2fd55-6bca-4a6c-827c-e599aae23622" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-5ee2fd55-6bca-4a6c-827c-e599aae23622" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-67f694ed-c3fe-4292-8ed3-a2aaf3cd7403" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-67f694ed-c3fe-4292-8ed3-a2aaf3cd7403" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Deleting offline snapshot 67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 of volume 5ee2fd55-6bca-4a6c-827c-e599aae23622 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:03:47 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] snapshot_file for this snap is: volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc 1073741824" returned: 0 in 0.619s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2d2a70-1cc0-466a-9055-b6e2a338d57f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:47 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc Sep 19 00:03:47 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:47 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 Sep 19 00:03:47 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:47 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc" returned: 0 in 0.293s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe15287-1c3c-4cf7-a4f4-43792dedcf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211b68ae-cdeb-49fd-8997-64547f1abcdc', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec11ba4-767e-4f67-bc4f-4bbebdb6207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:47 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Volume volume-211b68ae-cdeb-49fd-8997-64547f1abcdc (211b68ae-cdeb-49fd-8997-64547f1abcdc): created successfully Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec11ba4-767e-4f67-bc4f-4bbebdb6207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Flow 'volume_create_manager' (c48d892b-1ff7-4f4a-bee3-186889971ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d049e156-e7aa-4c0d-8ae7-342bc00a109e tempest-ProjectReaderTests-902715026 None] Created volume successfully. Sep 19 00:03:47 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403" returned: 0 in 0.469s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ee2fd55-6bca-4a6c-827c-e599aae23622(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e678206-fc0d-40b8-b612-2dd1d2cbf6f8]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:48 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 Sep 19 00:03:48 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:48 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622" returned: 0 in 0.426s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:48 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 Sep 19 00:03:48 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Flow 'volume_create_manager' (6351ab2f-2486-400f-8f20-c784827e268a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3632a9-482e-455b-a529-64024e852a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3632a9-482e-455b-a529-64024e852a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1965745424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee289395-9a08-492c-af3e-62783af84d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec2e3adc45400e8feb92d96090d3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:49Z,use_quota=True,user_id='7f6d7ce226db491b81194826c99f73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111512d3-a5ad-4839-9eb8-d1f6af33ebaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111512d3-a5ad-4839-9eb8-d1f6af33ebaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320df35a-3403-44c1-acba-12a0b9a639b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320df35a-3403-44c1-acba-12a0b9a639b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee289395-9a08-492c-af3e-62783af84d92', 'volume_name': 'volume-ee289395-9a08-492c-af3e-62783af84d92', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318c1ee5-19cf-430d-ad8d-a7ab0b69b103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318c1ee5-19cf-430d-ad8d-a7ab0b69b103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482e6844-db66-44e3-a58d-e549091db246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:48 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume ee289395-9a08-492c-af3e-62783af84d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee289395-9a08-492c-af3e-62783af84d92', 'volume_size': 1} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] Creating offline snapshot 1f9aafbd-9087-4cd7-a92c-1b384e5486fd of volume 211b68ae-cdeb-49fd-8997-64547f1abcdc {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[994af6e8-a43c-44a9-a8ce-d25e279ffd99]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:48 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403" returned: 0 in 0.437s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:48 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403 Sep 19 00:03:48 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:48 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc Sep 19 00:03:48 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:49 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622.67f694ed-c3fe-4292-8ed3-a2aaf3cd7403" returned: 0 in 0.276s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:49 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc" returned: 0 in 0.411s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-67f694ed-c3fe-4292-8ed3-a2aaf3cd7403" released by "_delete_snapshot" :: held 1.776s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-5ee2fd55-6bca-4a6c-827c-e599aae23622" released by "delete_snapshot" :: held 1.810s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:49 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd 1G Sep 19 00:03:49 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Created reservations ['e2e5dbc1-b0fe-46ff-8dbd-097068559d14', 'e305e943-5118-4c00-98cf-75a393f3ce3b', '25d4720d-bfee-4d57-8be7-4ebfa45883a4', 'd77cd48a-4c0e-4394-9157-fad4c5a90140'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Delete snapshot completed successfully. Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3cc784b1-3f50-4089-b67b-55e7b7e21391 tempest-ProjectMemberTests-883983225 None] Lock "cinder-67f694ed-c3fe-4292-8ed3-a2aaf3cd7403-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-5ee2fd55-6bca-4a6c-827c-e599aae23622-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Lock "cinder-5ee2fd55-6bca-4a6c-827c-e599aae23622-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:49 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd 1G" returned: 0 in 0.565s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-211b68ae-cdeb-49fd-8997-64547f1abcdc -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:49 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-211b68ae-cdeb-49fd-8997-64547f1abcdc -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd Sep 19 00:03:49 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-5ee2fd55-6bca-4a6c-827c-e599aae23622" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-5ee2fd55-6bca-4a6c-827c-e599aae23622" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[11544a15-d780-494a-ac3b-13d5e33b0ee8]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:49 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 Sep 19 00:03:49 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:50 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-211b68ae-cdeb-49fd-8997-64547f1abcdc -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd" returned: 0 in 0.330s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:50 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd is being set with open permissions: ugo+rw Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:50 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd Sep 19 00:03:50 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:50 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622" returned: 0 in 0.409s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:50 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622 Sep 19 00:03:50 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:50 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:50 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.info Sep 19 00:03:50 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:50 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-5ee2fd55-6bca-4a6c-827c-e599aae23622" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-5ee2fd55-6bca-4a6c-827c-e599aae23622" released by "delete_volume" :: held 0.768s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Created reservations ['db44eb80-1af8-4e65-802f-414fa00a6ab8', '8f5b8ffc-b0b5-4497-adf4-e20187c4ceaf', '5ad6c921-51d1-4d30-9a4f-fc17ca56f196', '6db19d0a-0847-4eaa-a7ee-c8da3ec5cfb7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:50 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.info" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:50 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.info is being set with open permissions: ugo+rw Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:50 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.info Sep 19 00:03:50 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:50 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:50 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:51 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.info" returned: 0 in 0.346s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.324s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1965745424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee289395-9a08-492c-af3e-62783af84d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec2e3adc45400e8feb92d96090d3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:49Z,use_quota=True,user_id='7f6d7ce226db491b81194826c99f73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Creating volume ee289395-9a08-492c-af3e-62783af84d92 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:51 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:51 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee289395-9a08-492c-af3e-62783af84d92 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.333s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:51 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee289395-9a08-492c-af3e-62783af84d92 1073741824 Sep 19 00:03:51 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Deleted volume successfully. Sep 19 00:03:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a53115b5-a983-4471-828f-a2a40dae9f0a tempest-ProjectReaderTests-902715026 None] Create snapshot completed successfully Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-819c8d18-a540-491f-aa2a-ddd46872a059 tempest-ProjectMemberTests-883983225 None] Lock "cinder-5ee2fd55-6bca-4a6c-827c-e599aae23622-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (f4121001-4d88-4877-b898-1c95659f2838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8059775-f031-4de3-b3f3-1027ab34e0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8059775-f031-4de3-b3f3-1027ab34e0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-963997141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ff36fa-0df0-4674-9873-551ff5a0a0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:51Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56993d5c-f9c0-4e16-9321-2e61cd90f93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56993d5c-f9c0-4e16-9321-2e61cd90f93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419d35f5-4825-4b50-a953-6f211a479fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419d35f5-4825-4b50-a953-6f211a479fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27ff36fa-0df0-4674-9873-551ff5a0a0f4', 'volume_name': 'volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0926c6c-594c-4cc9-871a-eada2fcf3bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0926c6c-594c-4cc9-871a-eada2fcf3bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0240cc-2749-4e46-a89d-f070651a04bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:51 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Volume 27ff36fa-0df0-4674-9873-551ff5a0a0f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4', 'volume_size': 1} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:51 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee289395-9a08-492c-af3e-62783af84d92 1073741824" returned: 0 in 0.540s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee289395-9a08-492c-af3e-62783af84d92 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:51 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee289395-9a08-492c-af3e-62783af84d92 Sep 19 00:03:51 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-1f9aafbd-9087-4cd7-a92c-1b384e5486fd-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:51 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee289395-9a08-492c-af3e-62783af84d92" returned: 0 in 0.272s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.374s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-963997141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ff36fa-0df0-4674-9873-551ff5a0a0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:51Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Creating volume 27ff36fa-0df0-4674-9873-551ff5a0a0f4 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:51 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482e6844-db66-44e3-a58d-e549091db246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee289395-9a08-492c-af3e-62783af84d92', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:51 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 1073741824 Sep 19 00:03:51 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784e7a10-93d5-4499-a913-fd60dc9c4480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Lock "cinder-1f9aafbd-9087-4cd7-a92c-1b384e5486fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-211b68ae-cdeb-49fd-8997-64547f1abcdc" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:51 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=270,cinder:SELECT=221,cinder:INSERT=78,cinder:DELETE=23 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 19 00:03:52 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume volume-ee289395-9a08-492c-af3e-62783af84d92 (ee289395-9a08-492c-af3e-62783af84d92): created successfully Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784e7a10-93d5-4499-a913-fd60dc9c4480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Flow 'volume_create_manager' (6351ab2f-2486-400f-8f20-c784827e268a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-211b68ae-cdeb-49fd-8997-64547f1abcdc" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-1f9aafbd-9087-4cd7-a92c-1b384e5486fd" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=213,cinder:UPDATE=291,cinder:DELETE=26,cinder:INSERT=79 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-1f9aafbd-9087-4cd7-a92c-1b384e5486fd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Deleting offline snapshot 1f9aafbd-9087-4cd7-a92c-1b384e5486fd of volume 211b68ae-cdeb-49fd-8997-64547f1abcdc {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] snapshot_file for this snap is: volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:03:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4a8334eb-f131-447d-bc21-38d498dd4840 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Created volume successfully. Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd63fb0-8a32-44e9-aea4-dfd0017fae82]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:52 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd Sep 19 00:03:52 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:52 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 1073741824" returned: 0 in 0.542s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:52 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd" returned: 0 in 0.455s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-211b68ae-cdeb-49fd-8997-64547f1abcdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:03:52 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 Sep 19 00:03:52 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[83153a09-950f-4718-b8d2-5f30bef0882e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:52 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc Sep 19 00:03:52 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:52 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4" returned: 0 in 0.311s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0240cc-2749-4e46-a89d-f070651a04bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32e43f7-95fe-4f86-913c-133018d49fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:52 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Volume volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 (27ff36fa-0df0-4674-9873-551ff5a0a0f4): created successfully Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32e43f7-95fe-4f86-913c-133018d49fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (f4121001-4d88-4877-b898-1c95659f2838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8d4a21fd-1509-406c-b51c-505e12d32ea5 tempest-ProjectMemberTests-883983225 None] Created volume successfully. Sep 19 00:03:53 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc" returned: 0 in 0.483s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:53 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd Sep 19 00:03:53 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:53 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd" returned: 0 in 0.530s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Flow 'volume_create_manager' (336cb9c1-b91b-40e9-b750-424cec2190a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:53 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3391d2-b3c3-4671-9ad3-fb2b7ad7e371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:53 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3391d2-b3c3-4671-9ad3-fb2b7ad7e371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368038733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263fa2c1-ddd5-493d-8312-9fc91afef84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec2e3adc45400e8feb92d96090d3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:54Z,use_quota=True,user_id='7f6d7ce226db491b81194826c99f73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b258f76-d69e-4c7b-99db-772326a255c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b258f76-d69e-4c7b-99db-772326a255c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e9db5a-ff9c-43b8-b70b-2d94bfbbde44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e9db5a-ff9c-43b8-b70b-2d94bfbbde44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '263fa2c1-ddd5-493d-8312-9fc91afef84d', 'volume_name': 'volume-263fa2c1-ddd5-493d-8312-9fc91afef84d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bccb56f-5a47-4ee6-bf01-db163edc37fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bccb56f-5a47-4ee6-bf01-db163edc37fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f539284c-6b5a-416f-b9c0-3c4115396aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:53 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume 263fa2c1-ddd5-493d-8312-9fc91afef84d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-263fa2c1-ddd5-493d-8312-9fc91afef84d', 'volume_size': 1} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368038733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263fa2c1-ddd5-493d-8312-9fc91afef84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec2e3adc45400e8feb92d96090d3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:54Z,use_quota=True,user_id='7f6d7ce226db491b81194826c99f73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Creating volume 263fa2c1-ddd5-493d-8312-9fc91afef84d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:53 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-263fa2c1-ddd5-493d-8312-9fc91afef84d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:53 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-263fa2c1-ddd5-493d-8312-9fc91afef84d 1073741824 Sep 19 00:03:53 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:53 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc.1f9aafbd-9087-4cd7-a92c-1b384e5486fd" returned: 0 in 0.392s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-1f9aafbd-9087-4cd7-a92c-1b384e5486fd" released by "_delete_snapshot" :: held 1.998s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-211b68ae-cdeb-49fd-8997-64547f1abcdc" released by "delete_snapshot" :: held 2.034s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Created reservations ['e63d6608-7737-4c8a-a633-71bedd90b01b', '3a987cfe-c4c3-4b28-87ea-0b4af6b06abd', 'eb460e67-f3ad-4d6a-9e5a-415bcd1b0f86', '67a55a63-8b10-41b9-bf5e-b44680e350d8'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:54 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Delete snapshot completed successfully. Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-90b35f99-7e50-4c84-8ff7-4ec22e2047ca tempest-ProjectReaderTests-902715026 None] Lock "cinder-1f9aafbd-9087-4cd7-a92c-1b384e5486fd-delete_snapshot" released by "delete_snapshot" :: held 2.277s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Flow 'volume_create_manager' (4d6cbbcf-7dfd-4cf8-8edb-0283319502b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5bd63e4-2932-4e69-9e64-855eaeb0058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5bd63e4-2932-4e69-9e64-855eaeb0058f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-556781795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ddcabe-255d-466b-b7df-bf76ca21c0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec2e3adc45400e8feb92d96090d3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:54Z,use_quota=True,user_id='7f6d7ce226db491b81194826c99f73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce714205-e760-462b-ace6-91a47a33ce06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:54 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce714205-e760-462b-ace6-91a47a33ce06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced0b8eb-69ca-414f-9c18-bd4a438ac72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced0b8eb-69ca-414f-9c18-bd4a438ac72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ddcabe-255d-466b-b7df-bf76ca21c0c5', 'volume_name': 'volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1036816b-028d-418f-850c-c7c516520c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1036816b-028d-418f-850c-c7c516520c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b897815-d14e-491a-a1d2-9654ea8b149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume d4ddcabe-255d-466b-b7df-bf76ca21c0c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5', 'volume_size': 1} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-263fa2c1-ddd5-493d-8312-9fc91afef84d 1073741824" returned: 0 in 0.749s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-263fa2c1-ddd5-493d-8312-9fc91afef84d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:54 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-263fa2c1-ddd5-493d-8312-9fc91afef84d Sep 19 00:03:54 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Flow 'volume_create_manager' (ca500dcd-edb6-4adb-8328-e9dddb9fda69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af59c80-9df1-4396-ba5f-72a4191f9fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af59c80-9df1-4396-ba5f-72a4191f9fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1239873554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8268156-b409-49ae-babe-fb2e15d3d238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec2e3adc45400e8feb92d96090d3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:55Z,use_quota=True,user_id='7f6d7ce226db491b81194826c99f73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b4ecd8-c3f0-4d6f-a3d7-e36d66c51bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b4ecd8-c3f0-4d6f-a3d7-e36d66c51bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe70a67f-b66b-4710-be5b-319ddce88538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe70a67f-b66b-4710-be5b-319ddce88538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8268156-b409-49ae-babe-fb2e15d3d238', 'volume_name': 'volume-f8268156-b409-49ae-babe-fb2e15d3d238', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba50b877-6226-4fbe-93ea-330d03410aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba50b877-6226-4fbe-93ea-330d03410aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74a9e86-196e-4fbb-b073-b30ef288a2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume f8268156-b409-49ae-babe-fb2e15d3d238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8268156-b409-49ae-babe-fb2e15d3d238', 'volume_size': 1} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:54 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-263fa2c1-ddd5-493d-8312-9fc91afef84d" returned: 0 in 0.341s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.654s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f539284c-6b5a-416f-b9c0-3c4115396aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-263fa2c1-ddd5-493d-8312-9fc91afef84d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e76496e-dd02-437c-aed4-d653e6cffedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] Creating offline snapshot bc22960c-939f-4924-9b70-b4ad10b1edaa of volume 27ff36fa-0df0-4674-9873-551ff5a0a0f4 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:03:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume volume-263fa2c1-ddd5-493d-8312-9fc91afef84d (263fa2c1-ddd5-493d-8312-9fc91afef84d): created successfully Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e76496e-dd02-437c-aed4-d653e6cffedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Flow 'volume_create_manager' (336cb9c1-b91b-40e9-b750-424cec2190a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19d6b17-e14f-41b6-9521-f271ac1b2322]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-bb76b6d9-920a-4061-bc96-741a4f3cd126 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Created volume successfully. Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Flow 'volume_create_manager' (60c0807a-6ecc-4368-ae14-24aa7afc1148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35aa3b68-dfcf-48e7-89cd-91ea5ab5a377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:55 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 Sep 19 00:03:55 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35aa3b68-dfcf-48e7-89cd-91ea5ab5a377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1190054641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0be400-9eb6-4ac2-a986-cb7b0574fe16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec2e3adc45400e8feb92d96090d3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:55Z,use_quota=True,user_id='7f6d7ce226db491b81194826c99f73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53de6e47-c428-4ced-a797-e6e02a39ab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53de6e47-c428-4ced-a797-e6e02a39ab3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50508783-a007-425f-82bd-fbad851bcf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50508783-a007-425f-82bd-fbad851bcf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf0be400-9eb6-4ac2-a986-cb7b0574fe16', 'volume_name': 'volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9113460-9e7d-4abb-8bee-9b07fead99d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9113460-9e7d-4abb-8bee-9b07fead99d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0013652-91c7-4f60-bd17-9028ce56100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume bf0be400-9eb6-4ac2-a986-cb7b0574fe16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16', 'volume_size': 1} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-211b68ae-cdeb-49fd-8997-64547f1abcdc-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Lock "cinder-211b68ae-cdeb-49fd-8997-64547f1abcdc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-211b68ae-cdeb-49fd-8997-64547f1abcdc" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-211b68ae-cdeb-49fd-8997-64547f1abcdc" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:55 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4" returned: 0 in 0.526s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc3dcf3-17f1-4036-9b55-dbc781d674e5]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:55 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa 1G Sep 19 00:03:55 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Flow 'volume_create_manager' (fa215b82-1b09-48c0-b3ba-6e7caeaed355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdb5631-d83d-4e1f-a8f7-f0268f24ea67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:55 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc Sep 19 00:03:55 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcdb5631-d83d-4e1f-a8f7-f0268f24ea67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1826735185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb89540f-a47b-457f-b947-cde86d200cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec2e3adc45400e8feb92d96090d3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:56Z,use_quota=True,user_id='7f6d7ce226db491b81194826c99f73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a59f266-4cf1-4857-8f7d-d9d6b645be90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a59f266-4cf1-4857-8f7d-d9d6b645be90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f0d01d-f756-40d7-9669-f932d967b8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f0d01d-f756-40d7-9669-f932d967b8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb89540f-a47b-457f-b947-cde86d200cc5', 'volume_name': 'volume-bb89540f-a47b-457f-b947-cde86d200cc5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95f5ae7-f146-4fb4-8a9c-136d2412dc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95f5ae7-f146-4fb4-8a9c-136d2412dc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd2828a-739f-421e-85d6-da20441c0c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume bb89540f-a47b-457f-b947-cde86d200cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb89540f-a47b-457f-b947-cde86d200cc5', 'volume_size': 1} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:55 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc" returned: 0 in 0.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:56 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc Sep 19 00:03:56 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:56 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa 1G" returned: 0 in 0.542s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:56 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa Sep 19 00:03:56 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:56 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-211b68ae-cdeb-49fd-8997-64547f1abcdc" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-211b68ae-cdeb-49fd-8997-64547f1abcdc" released by "delete_volume" :: held 0.790s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Created reservations ['4afcff59-33c7-41a5-bb5a-e26f40887577', '6e4a1ee1-89db-4a5b-b4b2-55d22b15dfe3', 'd61fb810-0a42-4ecd-b828-177de5c83ab5', '8ceb188e-554d-42f4-9c7b-0963b9cd2f40'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:56 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa" returned: 0 in 0.346s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:56 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa is being set with open permissions: ugo+rw Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:56 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:03:56 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:56 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa Sep 19 00:03:56 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:56 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.324s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:03:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Deleted volume successfully. Sep 19 00:03:56 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa" returned: 0 in 0.340s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6846a0eb-0ef3-4874-bb79-af9b076f3dc5 tempest-ProjectReaderTests-902715026 None] Lock "cinder-211b68ae-cdeb-49fd-8997-64547f1abcdc-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:56 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.info Sep 19 00:03:56 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:57 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Flow 'volume_create_manager' (c14a3c10-d72f-4d1d-b65c-2c3c30c8e96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e34abc-de51-46a5-8419-68f284defc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.info" returned: 0 in 0.339s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:57 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.info is being set with open permissions: ugo+rw Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e34abc-de51-46a5-8419-68f284defc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674941271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499f3282-a897-453a-9150-992c0722710d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c17acac06e342d892261e5fe98c16a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:57Z,use_quota=True,user_id='5851a32bb5c04787b329a9e874b8db68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:57 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.info Sep 19 00:03:57 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd75c530-5802-45aa-9276-88b7ddfa3c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd75c530-5802-45aa-9276-88b7ddfa3c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac9edb2-ec7a-490b-89b3-76a05a07c3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac9edb2-ec7a-490b-89b3-76a05a07c3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499f3282-a897-453a-9150-992c0722710d', 'volume_name': 'volume-499f3282-a897-453a-9150-992c0722710d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db06d191-0ade-4b91-91a8-11b3360d1a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db06d191-0ade-4b91-91a8-11b3360d1a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f275d636-83bd-4338-8add-dbc1e089b87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:57 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Volume 499f3282-a897-453a-9150-992c0722710d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499f3282-a897-453a-9150-992c0722710d', 'volume_size': 1} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:57 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.info" returned: 0 in 0.284s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.938s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-556781795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ddcabe-255d-466b-b7df-bf76ca21c0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec2e3adc45400e8feb92d96090d3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:54Z,use_quota=True,user_id='7f6d7ce226db491b81194826c99f73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Creating volume d4ddcabe-255d-466b-b7df-bf76ca21c0c5 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:57 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:57 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5 1073741824 Sep 19 00:03:57 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f9f698d8-8d25-4723-a87b-a28e1f5b3d0f tempest-ProjectMemberTests-883983225 None] Create snapshot completed successfully Sep 19 00:03:57 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5 1073741824" returned: 0 in 0.471s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:57 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5 Sep 19 00:03:57 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-bc22960c-939f-4924-9b70-b4ad10b1edaa-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Lock "cinder-bc22960c-939f-4924-9b70-b4ad10b1edaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-27ff36fa-0df0-4674-9873-551ff5a0a0f4" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-27ff36fa-0df0-4674-9873-551ff5a0a0f4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-bc22960c-939f-4924-9b70-b4ad10b1edaa" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-bc22960c-939f-4924-9b70-b4ad10b1edaa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Deleting offline snapshot bc22960c-939f-4924-9b70-b4ad10b1edaa of volume 27ff36fa-0df0-4674-9873-551ff5a0a0f4 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] snapshot_file for this snap is: volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[10038b28-0b15-464b-a137-22033cb69212]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:58 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5" returned: 0 in 0.288s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.527s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1239873554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8268156-b409-49ae-babe-fb2e15d3d238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec2e3adc45400e8feb92d96090d3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:55Z,use_quota=True,user_id='7f6d7ce226db491b81194826c99f73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Creating volume f8268156-b409-49ae-babe-fb2e15d3d238 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:58 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f8268156-b409-49ae-babe-fb2e15d3d238 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b897815-d14e-491a-a1d2-9654ea8b149d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:58 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f8268156-b409-49ae-babe-fb2e15d3d238 1073741824 Sep 19 00:03:58 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ffc876-d2dc-46ff-92dc-89e2bd0b0314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5 (d4ddcabe-255d-466b-b7df-bf76ca21c0c5): created successfully Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ffc876-d2dc-46ff-92dc-89e2bd0b0314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Flow 'volume_create_manager' (4d6cbbcf-7dfd-4cf8-8edb-0283319502b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:58 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa Sep 19 00:03:58 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-17ba3b7d-453a-48e8-abc6-32121cccd980 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Created volume successfully. Sep 19 00:03:58 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa" returned: 0 in 0.435s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd405a3-1917-4fe9-bfca-fd91f4e3c19f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:58 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f8268156-b409-49ae-babe-fb2e15d3d238 1073741824" returned: 0 in 0.575s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:58 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 Sep 19 00:03:58 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f8268156-b409-49ae-babe-fb2e15d3d238 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:58 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f8268156-b409-49ae-babe-fb2e15d3d238 Sep 19 00:03:58 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:59 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4" returned: 0 in 0.427s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:59 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f8268156-b409-49ae-babe-fb2e15d3d238" returned: 0 in 0.279s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.932s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1190054641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0be400-9eb6-4ac2-a986-cb7b0574fe16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec2e3adc45400e8feb92d96090d3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:55Z,use_quota=True,user_id='7f6d7ce226db491b81194826c99f73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Creating volume bf0be400-9eb6-4ac2-a986-cb7b0574fe16 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:03:59 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa Sep 19 00:03:59 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:03:59 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74a9e86-196e-4fbb-b073-b30ef288a2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8268156-b409-49ae-babe-fb2e15d3d238', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:59 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16 1073741824 Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1363286b-67a1-46c5-ae21-8eb3c8a22958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:03:59 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:59 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume volume-f8268156-b409-49ae-babe-fb2e15d3d238 (f8268156-b409-49ae-babe-fb2e15d3d238): created successfully Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1363286b-67a1-46c5-ae21-8eb3c8a22958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Flow 'volume_create_manager' (ca500dcd-edb6-4adb-8328-e9dddb9fda69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:03:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-32163aef-a89d-4bb5-b224-53f8297dc3e2 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Created volume successfully. Sep 19 00:03:59 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa" returned: 0 in 0.414s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:59 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa Sep 19 00:03:59 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:59 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16 1073741824" returned: 0 in 0.541s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:03:59 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16 Sep 19 00:03:59 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:03:59 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4.bc22960c-939f-4924-9b70-b4ad10b1edaa" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-bc22960c-939f-4924-9b70-b4ad10b1edaa" released by "_delete_snapshot" :: held 1.718s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-27ff36fa-0df0-4674-9873-551ff5a0a0f4" released by "delete_snapshot" :: held 1.747s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:03:59 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Created reservations ['4c63ee19-8872-4bf8-9218-f22917758d8b', '7b703647-805e-4cab-ac11-e0fa5a3852df', '0ab6a2e6-4f67-4668-b0a6-369f44a26695', '26fe8689-8be5-4ac2-abee-bc6c53cccef7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Delete snapshot completed successfully. Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c302150d-9c7b-4ec6-8c98-8401c5f3baeb tempest-ProjectMemberTests-883983225 None] Lock "cinder-bc22960c-939f-4924-9b70-b4ad10b1edaa-delete_snapshot" released by "delete_snapshot" :: held 1.917s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:00 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16" returned: 0 in 0.289s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.337s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1826735185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb89540f-a47b-457f-b947-cde86d200cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cec2e3adc45400e8feb92d96090d3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:56Z,use_quota=True,user_id='7f6d7ce226db491b81194826c99f73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Creating volume bb89540f-a47b-457f-b947-cde86d200cc5 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:00 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb89540f-a47b-457f-b947-cde86d200cc5 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0013652-91c7-4f60-bd17-9028ce56100f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f72ebd3-cd9a-47af-a565-5eb9684be437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:00 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb89540f-a47b-457f-b947-cde86d200cc5 1073741824 Sep 19 00:04:00 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16 (bf0be400-9eb6-4ac2-a986-cb7b0574fe16): created successfully Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f72ebd3-cd9a-47af-a565-5eb9684be437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Flow 'volume_create_manager' (60c0807a-6ecc-4368-ae14-24aa7afc1148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4ec2c410-64f8-41ac-9f04-5b08fc7ec5c4 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Created volume successfully. Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-27ff36fa-0df0-4674-9873-551ff5a0a0f4-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Lock "cinder-27ff36fa-0df0-4674-9873-551ff5a0a0f4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-27ff36fa-0df0-4674-9873-551ff5a0a0f4" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-27ff36fa-0df0-4674-9873-551ff5a0a0f4" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7154a9-f8e2-4ea4-b659-202ae93ba9fd]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Flow 'volume_create_manager' (ce5d28a3-f99e-489e-ab5a-0dfbb387ba53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e897b88d-6ef2-417f-863f-f03ecf9bf37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e897b88d-6ef2-417f-863f-f03ecf9bf37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-381083584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3cafda-bfdb-40b8-b316-476eff3cacf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bfa3dcd2aa4c2ab2c561c5da1ba0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:00Z,use_quota=True,user_id='ac7ae404621d4a30beab59704fdb4a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f3ffc4-8367-4745-b562-f5bd6654c7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f3ffc4-8367-4745-b562-f5bd6654c7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f3347d-be96-41ab-8a22-705afb073fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f3347d-be96-41ab-8a22-705afb073fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3cafda-bfdb-40b8-b316-476eff3cacf4', 'volume_name': 'volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541ce566-32a3-42fe-85a5-9f39b4dc01ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541ce566-32a3-42fe-85a5-9f39b4dc01ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80fc16c-3cdf-4daa-a632-95d6820555bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Volume ad3cafda-bfdb-40b8-b316-476eff3cacf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4', 'volume_size': 1} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:00 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 Sep 19 00:04:00 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:00 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb89540f-a47b-457f-b947-cde86d200cc5 1073741824" returned: 0 in 0.514s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb89540f-a47b-457f-b947-cde86d200cc5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:00 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb89540f-a47b-457f-b947-cde86d200cc5 Sep 19 00:04:00 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:00 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4" returned: 0 in 0.384s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:00 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4 Sep 19 00:04:00 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:00 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb89540f-a47b-457f-b947-cde86d200cc5" returned: 0 in 0.267s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.677s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674941271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499f3282-a897-453a-9150-992c0722710d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c17acac06e342d892261e5fe98c16a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:03:57Z,use_quota=True,user_id='5851a32bb5c04787b329a9e874b8db68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Creating volume 499f3282-a897-453a-9150-992c0722710d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:00 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd2828a-739f-421e-85d6-da20441c0c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb89540f-a47b-457f-b947-cde86d200cc5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:00 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d 1073741824 Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b888eb-136d-4892-a602-1807971bd10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:00 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Volume volume-bb89540f-a47b-457f-b947-cde86d200cc5 (bb89540f-a47b-457f-b947-cde86d200cc5): created successfully Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b888eb-136d-4892-a602-1807971bd10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Flow 'volume_create_manager' (fa215b82-1b09-48c0-b3ba-6e7caeaed355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ac923a5c-3288-4784-a26b-ed714ee192a0 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Created volume successfully. Sep 19 00:04:01 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-27ff36fa-0df0-4674-9873-551ff5a0a0f4" returned: 0 in 0.258s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-27ff36fa-0df0-4674-9873-551ff5a0a0f4" released by "delete_volume" :: held 0.713s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Created reservations ['6678b5e7-bd69-4175-9a45-6fba0a9a6e49', '14ab534b-2252-445b-ae57-918d772553b3', '74fb5839-6b6a-45d3-97e2-f6130aeedac5', 'c4ffa193-33a2-47c4-bac0-38e3c1b84ea2'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "cinder-bb89540f-a47b-457f-b947-cde86d200cc5-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-bb89540f-a47b-457f-b947-cde86d200cc5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "cinder-quobyte-bb89540f-a47b-457f-b947-cde86d200cc5" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-quobyte-bb89540f-a47b-457f-b947-cde86d200cc5" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:01 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:01 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc4b025-8aae-4515-ba33-505b66b7301a]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb89540f-a47b-457f-b947-cde86d200cc5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:01 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d 1073741824" returned: 0 in 0.582s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:01 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb89540f-a47b-457f-b947-cde86d200cc5 Sep 19 00:04:01 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:01 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d Sep 19 00:04:01 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:01 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.289s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Deleted volume successfully. Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8add86db-878a-4991-86d3-cd745a5a0686 tempest-ProjectMemberTests-883983225 None] Lock "cinder-27ff36fa-0df0-4674-9873-551ff5a0a0f4-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:01 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb89540f-a47b-457f-b947-cde86d200cc5" returned: 0 in 0.402s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb89540f-a47b-457f-b947-cde86d200cc5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:01 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb89540f-a47b-457f-b947-cde86d200cc5 Sep 19 00:04:01 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:01 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d" returned: 0 in 0.346s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.326s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-381083584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3cafda-bfdb-40b8-b316-476eff3cacf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bfa3dcd2aa4c2ab2c561c5da1ba0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:00Z,use_quota=True,user_id='ac7ae404621d4a30beab59704fdb4a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Creating volume ad3cafda-bfdb-40b8-b316-476eff3cacf4 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:01 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f275d636-83bd-4338-8add-dbc1e089b87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499f3282-a897-453a-9150-992c0722710d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:01 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4 1073741824 Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85866d9-2d45-4f60-a8ba-4abe818e6d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:01 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:01 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Volume volume-499f3282-a897-453a-9150-992c0722710d (499f3282-a897-453a-9150-992c0722710d): created successfully Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85866d9-2d45-4f60-a8ba-4abe818e6d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Flow 'volume_create_manager' (c14a3c10-d72f-4d1d-b65c-2c3c30c8e96f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-416a11c4-a5ba-4c64-8477-e9a57a33ae61 tempest-ProjectReaderTests-902715026 None] Created volume successfully. Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (73bb093e-2164-4a1b-b387-fc132c92526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34efd722-add5-4be8-8d08-7e9a3edda31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:02 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34efd722-add5-4be8-8d08-7e9a3edda31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-989152163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6dc9c7-9710-4226-a2cd-31bc1ba2896d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:02Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889718c8-06b3-44d0-b2a4-ba0b3bb964b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889718c8-06b3-44d0-b2a4-ba0b3bb964b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2868fd6-7456-48c6-99af-d6f10f894719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2868fd6-7456-48c6-99af-d6f10f894719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6dc9c7-9710-4226-a2cd-31bc1ba2896d', 'volume_name': 'volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b3604c-3799-4ddd-8c7a-41838b9dc664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b3604c-3799-4ddd-8c7a-41838b9dc664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab693ba4-42ed-4afc-830d-a571a47eb074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Volume bb6dc9c7-9710-4226-a2cd-31bc1ba2896d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d', 'volume_size': 1} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb89540f-a47b-457f-b947-cde86d200cc5" returned: 0 in 0.322s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-quobyte-bb89540f-a47b-457f-b947-cde86d200cc5" released by "delete_volume" :: held 0.767s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Created reservations ['29c15f5f-ecb5-40ec-8665-2de5f6f80d5b', 'ba3000d2-874d-4445-94f3-f7c5a47ea570', '91d4f7b0-528a-43d5-b2c6-01a49840cac3', '07c8d204-ca5b-455c-b1cf-89740b92fa7c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:02 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:02 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "cinder-bf0be400-9eb6-4ac2-a986-cb7b0574fe16-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-bf0be400-9eb6-4ac2-a986-cb7b0574fe16-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:02 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4 1073741824" returned: 0 in 0.568s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "cinder-quobyte-bf0be400-9eb6-4ac2-a986-cb7b0574fe16" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:02 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.343s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:02 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4 Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-quobyte-bf0be400-9eb6-4ac2-a986-cb7b0574fe16" acquired by "delete_volume" :: waited 0.060s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:02 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Deleted volume successfully. Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d405ae0a-49d0-4625-8c71-d397d0f3b6ea]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-61a35e5f-6e45-48ab-9087-0b83fe4cf5b9 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-bb89540f-a47b-457f-b947-cde86d200cc5-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:02 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16 Sep 19 00:04:02 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:02 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4" returned: 0 in 0.298s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.736s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-989152163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6dc9c7-9710-4226-a2cd-31bc1ba2896d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:02Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Creating volume bb6dc9c7-9710-4226-a2cd-31bc1ba2896d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:02 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80fc16c-3cdf-4daa-a632-95d6820555bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f027235-2d7d-4692-b078-36cbdfd3a58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:02 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d 1073741824 Sep 19 00:04:02 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Volume volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4 (ad3cafda-bfdb-40b8-b316-476eff3cacf4): created successfully Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f027235-2d7d-4692-b078-36cbdfd3a58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Flow 'volume_create_manager' (ce5d28a3-f99e-489e-ab5a-0dfbb387ba53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6f8f8a0a-b268-44d7-8a0d-0ff2231ef018 tempest-ProjectReaderTests-2091490680 None] Created volume successfully. Sep 19 00:04:03 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16" returned: 0 in 0.389s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:03 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16 Sep 19 00:04:03 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:03 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:03 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d 1073741824" returned: 0 in 0.434s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bf0be400-9eb6-4ac2-a986-cb7b0574fe16" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-quobyte-bf0be400-9eb6-4ac2-a986-cb7b0574fe16" released by "delete_volume" :: held 0.720s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:03 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d Sep 19 00:04:03 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Created reservations ['df621155-a634-4f9f-b889-ef95ee657cad', '86d520d3-caa2-4412-a59e-d670b4832e75', 'b56f074d-b146-46bd-8e61-bf7634dff05d', '419bab71-0efa-4038-b0c3-d12769e84e73'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:03 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:03 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:03 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d" returned: 0 in 0.258s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.925s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab693ba4-42ed-4afc-830d-a571a47eb074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d551b594-c673-4708-9239-d4ba2fd9b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] Creating offline snapshot 0b5e1e4e-51bb-476e-a15b-bea29ad26300 of volume 499f3282-a897-453a-9150-992c0722710d {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:04:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Volume volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d (bb6dc9c7-9710-4226-a2cd-31bc1ba2896d): created successfully Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d551b594-c673-4708-9239-d4ba2fd9b569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (73bb093e-2164-4a1b-b387-fc132c92526c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bee7273-d588-476a-baa4-727ed8b15d0f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:03 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "cinder-f8268156-b409-49ae-babe-fb2e15d3d238-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cbf18b35-9bde-4e68-ac09-5b6ef7eec44d tempest-ProjectMemberTests-883983225 None] Created volume successfully. Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.300s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Deleted volume successfully. Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-f8268156-b409-49ae-babe-fb2e15d3d238-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5cb40716-ff33-41d0-8cf6-a9abb782ba53 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-bf0be400-9eb6-4ac2-a986-cb7b0574fe16-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "cinder-quobyte-f8268156-b409-49ae-babe-fb2e15d3d238" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-quobyte-f8268156-b409-49ae-babe-fb2e15d3d238" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:03 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d Sep 19 00:04:03 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b243fe-48c6-492c-8384-bc59a5b535b0]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f8268156-b409-49ae-babe-fb2e15d3d238 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "cinder-ad3cafda-bfdb-40b8-b316-476eff3cacf4-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Lock "cinder-ad3cafda-bfdb-40b8-b316-476eff3cacf4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "cinder-quobyte-ad3cafda-bfdb-40b8-b316-476eff3cacf4" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Lock "cinder-quobyte-ad3cafda-bfdb-40b8-b316-476eff3cacf4" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:04 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f8268156-b409-49ae-babe-fb2e15d3d238 Sep 19 00:04:04 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae4f08e-ecce-46cc-acd5-84b8ed35d894]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:04 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4 Sep 19 00:04:04 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:04 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d" returned: 0 in 0.470s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:04 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 1G Sep 19 00:04:04 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:04 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f8268156-b409-49ae-babe-fb2e15d3d238" returned: 0 in 0.488s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f8268156-b409-49ae-babe-fb2e15d3d238 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:04 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f8268156-b409-49ae-babe-fb2e15d3d238 Sep 19 00:04:04 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:04 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4" returned: 0 in 0.444s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:04 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4 Sep 19 00:04:04 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:04 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 1G" returned: 0 in 0.513s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-499f3282-a897-453a-9150-992c0722710d -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:04 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-f8268156-b409-49ae-babe-fb2e15d3d238" returned: 0 in 0.322s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:04 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-499f3282-a897-453a-9150-992c0722710d -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 Sep 19 00:04:04 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-quobyte-f8268156-b409-49ae-babe-fb2e15d3d238" released by "delete_volume" :: held 0.871s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Created reservations ['2eaa9e26-4776-4657-ad22-6eb577ff5719', '5d073a79-c505-4a5a-a3d3-0c1e231dac28', '9c01bcb6-d686-4d8e-adf2-16073b0279ca', '8a0c4853-6026-48e1-bb75-43a034668167'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:04 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ad3cafda-bfdb-40b8-b316-476eff3cacf4" returned: 0 in 0.311s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Lock "cinder-quobyte-ad3cafda-bfdb-40b8-b316-476eff3cacf4" released by "delete_volume" :: held 0.817s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Created reservations ['ab69cef9-dc1c-4887-af7f-270c76346652', 'ba00b41b-40fa-4cac-8b03-3a06ebf0f673', '5ae684bd-149f-4109-b8ff-c3520c251f29', '18f49bf8-42b0-4566-938a-6eacc917e5ce'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:04 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:04 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "cinder-d4ddcabe-255d-466b-b7df-bf76ca21c0c5-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-d4ddcabe-255d-466b-b7df-bf76ca21c0c5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "cinder-quobyte-d4ddcabe-255d-466b-b7df-bf76ca21c0c5" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-quobyte-d4ddcabe-255d-466b-b7df-bf76ca21c0c5" acquired by "delete_volume" :: waited 0.060s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:05 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:05 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-499f3282-a897-453a-9150-992c0722710d -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300" returned: 0 in 0.416s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:05 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:05 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 is being set with open permissions: ugo+rw Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0300094-eae4-4e1c-b637-a821749eedd9]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:05 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 Sep 19 00:04:05 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:05 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:05 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5 Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.363s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:05 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Deleted volume successfully. Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c28e492d-3ed6-474d-a039-acf474adf6aa tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-f8268156-b409-49ae-babe-fb2e15d3d238-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:05 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.330s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Deleted volume successfully. Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-da23a051-ed67-4cbc-b539-cd4060f39b21 tempest-ProjectReaderTests-2091490680 None] Lock "cinder-ad3cafda-bfdb-40b8-b316-476eff3cacf4-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:05 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300" returned: 0 in 0.397s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:05 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.info Sep 19 00:04:05 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:05 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5" returned: 0 in 0.463s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:05 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5 Sep 19 00:04:05 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Flow 'volume_create_manager' (7e314d94-c781-4352-a6e0-97d0f9b0f543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29dcd068-131e-4ea5-8fb3-c1f665a6543e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29dcd068-131e-4ea5-8fb3-c1f665a6543e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-987886887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc210c6f-6e89-4ebd-8d0e-c078f0dfe530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bfa3dcd2aa4c2ab2c561c5da1ba0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:06Z,use_quota=True,user_id='ac7ae404621d4a30beab59704fdb4a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b149f8c-0d6a-4054-9a27-d20eaa70ee88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b149f8c-0d6a-4054-9a27-d20eaa70ee88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08840bcf-a586-484f-a0a3-3545bc58ad9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08840bcf-a586-484f-a0a3-3545bc58ad9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc210c6f-6e89-4ebd-8d0e-c078f0dfe530', 'volume_name': 'volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814eb1bd-23d9-4f6c-9757-a8f99bf332a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814eb1bd-23d9-4f6c-9757-a8f99bf332a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166cb3e2-2636-47e4-9a27-e1ff3c77fdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Volume dc210c6f-6e89-4ebd-8d0e-c078f0dfe530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530', 'volume_size': 1} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:05 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.info" returned: 0 in 0.291s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:05 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.info is being set with open permissions: ugo+rw Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:05 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.info Sep 19 00:04:05 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:05 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-d4ddcabe-255d-466b-b7df-bf76ca21c0c5" returned: 0 in 0.276s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-quobyte-d4ddcabe-255d-466b-b7df-bf76ca21c0c5" released by "delete_volume" :: held 0.798s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Created reservations ['c698e352-b30c-42dd-aa9f-2b5680fff70e', 'e49e0153-3b63-423d-af62-9780c394d040', 'd93fccb0-b58f-4ef4-848b-64fcaa4178e4', 'f86ee800-343c-4670-b744-17c80899b2ed'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:06 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:06 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:06 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.info" returned: 0 in 0.253s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.493s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.751s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "cinder-263fa2c1-ddd5-493d-8312-9fc91afef84d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] Creating offline snapshot f9af5224-e50d-4e7e-9298-674ac08431cc of volume bb6dc9c7-9710-4226-a2cd-31bc1ba2896d {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-263fa2c1-ddd5-493d-8312-9fc91afef84d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5604fc3e-c767-4571-8fe3-98550bf68214]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:06 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d65c2dd0-e6df-4a3d-9ff6-e3f4e1a1612a tempest-ProjectReaderTests-902715026 None] Create snapshot completed successfully Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "cinder-quobyte-263fa2c1-ddd5-493d-8312-9fc91afef84d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-quobyte-263fa2c1-ddd5-493d-8312-9fc91afef84d" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdba0f5-8038-4b0a-991b-22d5939e215d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-263fa2c1-ddd5-493d-8312-9fc91afef84d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:06 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:06 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Deleted volume successfully. Sep 19 00:04:06 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d Sep 19 00:04:06 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4e486cb1-a1c1-42cc-b05f-1ee7698a9f2c tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-d4ddcabe-255d-466b-b7df-bf76ca21c0c5-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:06 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-263fa2c1-ddd5-493d-8312-9fc91afef84d Sep 19 00:04:06 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:06 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:06 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc 1G Sep 19 00:04:06 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:06 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-263fa2c1-ddd5-493d-8312-9fc91afef84d" returned: 0 in 0.400s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-263fa2c1-ddd5-493d-8312-9fc91afef84d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:06 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-263fa2c1-ddd5-493d-8312-9fc91afef84d Sep 19 00:04:06 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:06 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-263fa2c1-ddd5-493d-8312-9fc91afef84d" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-quobyte-263fa2c1-ddd5-493d-8312-9fc91afef84d" released by "delete_volume" :: held 0.712s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-0b5e1e4e-51bb-476e-a15b-bea29ad26300-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Lock "cinder-0b5e1e4e-51bb-476e-a15b-bea29ad26300-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-499f3282-a897-453a-9150-992c0722710d" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-499f3282-a897-453a-9150-992c0722710d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-0b5e1e4e-51bb-476e-a15b-bea29ad26300" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-0b5e1e4e-51bb-476e-a15b-bea29ad26300" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Deleting offline snapshot 0b5e1e4e-51bb-476e-a15b-bea29ad26300 of volume 499f3282-a897-453a-9150-992c0722710d {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] snapshot_file for this snap is: volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Created reservations ['942df0f5-dd1a-4e6c-9ae2-d71df0a9b1e1', 'd56934dc-6515-4ad1-ac39-08015f2555c6', 'b6654878-5bf9-4e6e-b5f4-f83230984f6b', 'ea6791fc-75c5-46c2-98ee-90ca4ab9629a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:07 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc 1G" returned: 0 in 0.495s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[127feaca-49c8-4e6a-8af5-c4d84634bbc7]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:07 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc Sep 19 00:04:07 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:07 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:07 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:07 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 Sep 19 00:04:07 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "cinder-ee289395-9a08-492c-af3e-62783af84d92-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-ee289395-9a08-492c-af3e-62783af84d92-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "cinder-quobyte-ee289395-9a08-492c-af3e-62783af84d92" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-quobyte-ee289395-9a08-492c-af3e-62783af84d92" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc08a55c-112b-478c-82d0-6e98e7ce5721]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee289395-9a08-492c-af3e-62783af84d92 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:07 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc" returned: 0 in 0.425s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:07 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc is being set with open permissions: ugo+rw Sep 19 00:04:07 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Deleted volume successfully. Sep 19 00:04:07 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc Sep 19 00:04:07 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7efb2d1b-35cd-4c7f-9cfe-4736badf2ea6 tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-263fa2c1-ddd5-493d-8312-9fc91afef84d-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:07 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee289395-9a08-492c-af3e-62783af84d92 Sep 19 00:04:07 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:07 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300" returned: 0 in 0.506s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-499f3282-a897-453a-9150-992c0722710d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeda1c31-418b-4deb-acd5-62b6cb448659]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:07 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d Sep 19 00:04:07 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:07 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc" returned: 0 in 0.289s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:07 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.info Sep 19 00:04:07 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:07 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee289395-9a08-492c-af3e-62783af84d92" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee289395-9a08-492c-af3e-62783af84d92 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:07 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee289395-9a08-492c-af3e-62783af84d92 Sep 19 00:04:07 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:08 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d" returned: 0 in 0.432s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:08 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.info" returned: 0 in 0.270s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:08 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.info is being set with open permissions: ugo+rw Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:08 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 Sep 19 00:04:08 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:08 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.info Sep 19 00:04:08 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:08 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-ee289395-9a08-492c-af3e-62783af84d92" returned: 0 in 0.275s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-quobyte-ee289395-9a08-492c-af3e-62783af84d92" released by "delete_volume" :: held 0.740s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Created reservations ['73a0f914-e456-4c9b-9382-89e8d8c36016', 'b86d9d5f-21d7-4323-b73a-1aa74dd4c92f', '38075830-30dd-41db-9580-f971441325c3', 'b464f9db-e7e8-4b03-ad7a-745e79622543'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:08 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:08 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:08 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.info" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.606s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-987886887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc210c6f-6e89-4ebd-8d0e-c078f0dfe530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bfa3dcd2aa4c2ab2c561c5da1ba0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:06Z,use_quota=True,user_id='ac7ae404621d4a30beab59704fdb4a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Creating volume dc210c6f-6e89-4ebd-8d0e-c078f0dfe530 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:08 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:08 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530 1073741824 Sep 19 00:04:08 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:08 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300" returned: 0 in 0.396s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c28a7997-7902-470a-bea7-3805f0e6dcc9 tempest-ProjectMemberTests-883983225 None] Create snapshot completed successfully Sep 19 00:04:08 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300 Sep 19 00:04:08 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:08 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.305s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Deleted volume successfully. Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-16de4b1d-1ab8-4a08-9e5f-f464963ec87a tempest-CreateVolumesFromSourceVolumeTest-1507953377 None] Lock "cinder-ee289395-9a08-492c-af3e-62783af84d92-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:08 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d.0b5e1e4e-51bb-476e-a15b-bea29ad26300" returned: 0 in 0.341s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-0b5e1e4e-51bb-476e-a15b-bea29ad26300" released by "_delete_snapshot" :: held 1.815s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-499f3282-a897-453a-9150-992c0722710d" released by "delete_snapshot" :: held 1.843s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Created reservations ['3d953d1b-6f1d-423c-993a-7b6fb4f19fd7', '541dcc1c-cf3b-4706-8267-bb54ca0c3ec9', 'e0f5972b-29bd-4f14-8a2f-da823b7dcef6', '8257bfc8-bd9b-4899-9fba-34d54eb7263f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Delete snapshot completed successfully. Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-917ae247-61a0-4c7c-ba2b-eefcd52c37d4 tempest-ProjectReaderTests-902715026 None] Lock "cinder-0b5e1e4e-51bb-476e-a15b-bea29ad26300-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:08 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530 1073741824" returned: 0 in 0.583s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:09 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530 Sep 19 00:04:09 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-499f3282-a897-453a-9150-992c0722710d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Lock "cinder-499f3282-a897-453a-9150-992c0722710d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-499f3282-a897-453a-9150-992c0722710d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-499f3282-a897-453a-9150-992c0722710d" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1104f38-4c09-4745-8cbf-3c697e4c6c3b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:09 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530" returned: 0 in 0.277s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166cb3e2-2636-47e4-9a27-e1ff3c77fdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7ce077-d0b3-4161-8c03-9da512580bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:09 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Volume volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530 (dc210c6f-6e89-4ebd-8d0e-c078f0dfe530): created successfully Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7ce077-d0b3-4161-8c03-9da512580bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Flow 'volume_create_manager' (7e314d94-c781-4352-a6e0-97d0f9b0f543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-eb4640ae-4477-450b-a523-d2d2a79ff1a6 tempest-ProjectReaderTests-2091490680 None] Created volume successfully. Sep 19 00:04:09 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d Sep 19 00:04:09 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-f9af5224-e50d-4e7e-9298-674ac08431cc-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Lock "cinder-f9af5224-e50d-4e7e-9298-674ac08431cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-f9af5224-e50d-4e7e-9298-674ac08431cc" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-f9af5224-e50d-4e7e-9298-674ac08431cc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Deleting offline snapshot f9af5224-e50d-4e7e-9298-674ac08431cc of volume bb6dc9c7-9710-4226-a2cd-31bc1ba2896d {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] snapshot_file for this snap is: volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae87e0ec-8d1b-4e91-8740-93fd750a805d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:09 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d" returned: 0 in 0.473s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:09 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d Sep 19 00:04:09 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:09 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc Sep 19 00:04:09 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "cinder-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Lock "cinder-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:10 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-499f3282-a897-453a-9150-992c0722710d" returned: 0 in 0.315s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-499f3282-a897-453a-9150-992c0722710d" released by "delete_volume" :: held 0.901s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "cinder-quobyte-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Lock "cinder-quobyte-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530" acquired by "delete_volume" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb29ae-4405-4761-84bc-906feb31f280]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Created reservations ['bf07279e-a9e8-41c8-9a63-795b380d46e5', '12345fe2-27ef-4cbb-96f4-8bd7e444a781', '76eff5de-3453-40da-b733-4706750f24f7', '079eee06-e576-4f87-8a32-b18536a579bc'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:10 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc" returned: 0 in 0.636s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[220cbdee-68ee-4c3c-8be7-9284d64c53d3]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:10 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530 Sep 19 00:04:10 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:10 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:10 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:10 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d Sep 19 00:04:10 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:10 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Deleted volume successfully. Sep 19 00:04:10 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa78a4d0-5422-4ac1-8bfd-97c6ac78fc76 tempest-ProjectReaderTests-902715026 None] Lock "cinder-499f3282-a897-453a-9150-992c0722710d-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530" returned: 0 in 0.698s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:10 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530 Sep 19 00:04:10 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:10 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d" returned: 0 in 0.574s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:11 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc Sep 19 00:04:11 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:11 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530" returned: 0 in 0.277s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Lock "cinder-quobyte-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530" released by "delete_volume" :: held 1.050s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Created reservations ['ddf86b04-2c74-43cc-9394-833b3ffeb5a7', 'a041e69e-dc7b-47d4-869d-82f5eb708dcb', 'f868c499-53fb-4693-8717-77ceaa76515e', 'ad5c149a-a2c7-4106-98ae-62f5cea99108'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:11 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:11 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:11 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc" returned: 0 in 0.456s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:11 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc Sep 19 00:04:11 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:11 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.282s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Deleted volume successfully. Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f2032d1-16ba-4f98-bed9-57c126f7fa64 tempest-ProjectReaderTests-2091490680 None] Lock "cinder-dc210c6f-6e89-4ebd-8d0e-c078f0dfe530-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:11 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d.f9af5224-e50d-4e7e-9298-674ac08431cc" returned: 0 in 0.310s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-f9af5224-e50d-4e7e-9298-674ac08431cc" released by "_delete_snapshot" :: held 2.121s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d" released by "delete_snapshot" :: held 2.152s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Created reservations ['73d5633e-346f-4450-b842-0a46ed32cd82', '3cbfb955-7c55-4818-a324-5afb6c32276d', '31c9aa12-9043-407e-b901-9b9c6852c84a', 'ae9a51dc-66cc-4e1c-ba60-29a37b2b65cf'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Delete snapshot completed successfully. Sep 19 00:04:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6ca9c97c-b0b0-47a3-9ddb-71ee6b9ccfc7 tempest-ProjectMemberTests-883983225 None] Lock "cinder-f9af5224-e50d-4e7e-9298-674ac08431cc-delete_snapshot" released by "delete_snapshot" :: held 2.337s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Flow 'volume_create_manager' (c4d6c041-1ea8-4fcf-a7b4-2e2d5382717f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2cc081-169b-464f-bfd1-593af22667b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2cc081-169b-464f-bfd1-593af22667b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111002939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c591ec3b-ac9a-426e-ac56-5b91aa713439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c17acac06e342d892261e5fe98c16a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:12Z,use_quota=True,user_id='5851a32bb5c04787b329a9e874b8db68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cee3d1-37c4-45c7-bb32-2bdc0e1f60ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cee3d1-37c4-45c7-bb32-2bdc0e1f60ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe2326a-efcd-416b-831d-d180e816e040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe2326a-efcd-416b-831d-d180e816e040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c591ec3b-ac9a-426e-ac56-5b91aa713439', 'volume_name': 'volume-c591ec3b-ac9a-426e-ac56-5b91aa713439', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f13cbc-d339-41db-8f85-0661e271de37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f13cbc-d339-41db-8f85-0661e271de37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c12e00-f2ad-41a7-8790-4ec639610628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Volume c591ec3b-ac9a-426e-ac56-5b91aa713439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c591ec3b-ac9a-426e-ac56-5b91aa713439', 'volume_size': 1} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111002939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c591ec3b-ac9a-426e-ac56-5b91aa713439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c17acac06e342d892261e5fe98c16a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:12Z,use_quota=True,user_id='5851a32bb5c04787b329a9e874b8db68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Creating volume c591ec3b-ac9a-426e-ac56-5b91aa713439 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:12 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:12 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 1073741824 Sep 19 00:04:12 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Flow 'volume_create_manager' (bbbefbda-48dd-4bfa-ac8b-540c04eb8611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09da9b2-604b-48cd-a225-8e2c3500befb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09da9b2-604b-48cd-a225-8e2c3500befb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57a0d79-4486-4bd8-a153-3cc822b6ce7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8848887330d9490986713627244034cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:12Z,use_quota=True,user_id='b7e56a4dbcc3443eb637932aecf82bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f021d6dd-ccf7-4774-946e-4a35a1635993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f021d6dd-ccf7-4774-946e-4a35a1635993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e883b722-4128-4bdb-8398-78c4ab270d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e883b722-4128-4bdb-8398-78c4ab270d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a57a0d79-4486-4bd8-a153-3cc822b6ce7e', 'volume_name': 'volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0c720f-6c1f-4ebb-acd3-96f497088601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0c720f-6c1f-4ebb-acd3-96f497088601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f6f09d-fab5-4a2d-87d7-28437e49400c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Volume a57a0d79-4486-4bd8-a153-3cc822b6ce7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e', 'volume_size': 1} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:12 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 1073741824" returned: 0 in 0.480s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:12 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 Sep 19 00:04:12 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Flow 'volume_create_manager' (e71bd3c8-8b07-4af6-b431-8a72815d55ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53aabe2-df49-4f0e-802c-b60cb6d9986d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53aabe2-df49-4f0e-802c-b60cb6d9986d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-520906778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdcae16-5df8-4955-a206-0abed88c0a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bfa3dcd2aa4c2ab2c561c5da1ba0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:13Z,use_quota=True,user_id='ac7ae404621d4a30beab59704fdb4a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65305f19-efd8-4464-996f-97833efcd2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65305f19-efd8-4464-996f-97833efcd2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478b8a1a-ce65-453f-bde1-368a7362b3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478b8a1a-ce65-453f-bde1-368a7362b3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdcae16-5df8-4955-a206-0abed88c0a06', 'volume_name': 'volume-bcdcae16-5df8-4955-a206-0abed88c0a06', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238ab538-5f5f-4678-b419-101f29275627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238ab538-5f5f-4678-b419-101f29275627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f856d8-e850-4502-9bf7-d2001a2b5cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Volume bcdcae16-5df8-4955-a206-0abed88c0a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdcae16-5df8-4955-a206-0abed88c0a06', 'volume_size': 1} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Lock "cinder-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:12 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439" returned: 0 in 0.303s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.689s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57a0d79-4486-4bd8-a153-3cc822b6ce7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8848887330d9490986713627244034cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:12Z,use_quota=True,user_id='b7e56a4dbcc3443eb637932aecf82bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Creating volume a57a0d79-4486-4bd8-a153-3cc822b6ce7e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:12 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c12e00-f2ad-41a7-8790-4ec639610628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c591ec3b-ac9a-426e-ac56-5b91aa713439', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:13 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e 1073741824 Sep 19 00:04:13 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c233aab-e141-4beb-9b26-85abe7442ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d" acquired by "delete_volume" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:13 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Volume volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 (c591ec3b-ac9a-426e-ac56-5b91aa713439): created successfully Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c233aab-e141-4beb-9b26-85abe7442ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Flow 'volume_create_manager' (c4d6c041-1ea8-4fcf-a7b4-2e2d5382717f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ad76f6-183d-4913-b598-e17226b30a95]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cfbe1852-5cca-4470-a36f-7c90c6229312 tempest-ProjectReaderTests-902715026 None] Created volume successfully. Sep 19 00:04:13 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d Sep 19 00:04:13 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:13 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e 1073741824" returned: 0 in 0.455s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:13 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e Sep 19 00:04:13 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:13 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d" returned: 0 in 0.401s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:13 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d Sep 19 00:04:13 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:13 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-520906778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdcae16-5df8-4955-a206-0abed88c0a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bfa3dcd2aa4c2ab2c561c5da1ba0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:13Z,use_quota=True,user_id='ac7ae404621d4a30beab59704fdb4a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Creating volume bcdcae16-5df8-4955-a206-0abed88c0a06 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:13 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bcdcae16-5df8-4955-a206-0abed88c0a06 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:13 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:13 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bcdcae16-5df8-4955-a206-0abed88c0a06 1073741824 Sep 19 00:04:13 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f6f09d-fab5-4a2d-87d7-28437e49400c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ff8445-4770-4baf-b6ed-016eb8764718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d" released by "delete_volume" :: held 0.774s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:13 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Volume volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e (a57a0d79-4486-4bd8-a153-3cc822b6ce7e): created successfully Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ff8445-4770-4baf-b6ed-016eb8764718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Flow 'volume_create_manager' (bbbefbda-48dd-4bfa-ac8b-540c04eb8611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d28dd86c-c8e5-4995-b6f8-5f5aac685127 tempest-CinderUnicodeTest-1342351950 None] Created volume successfully. Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Created reservations ['d8c5850e-7b41-4cf8-921c-352e37017be9', '86e6935a-803a-4112-8276-cd3f0f3f5e43', '5da71cbd-e79a-400d-8cd0-69eabd2a6e55', '6b1db6fa-b7fa-45ee-89ab-a32fee53f0f0'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:13 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:13 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:14 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.278s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Deleted volume successfully. Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-147d2cf8-5df8-4b62-901f-8548dbcb9a37 tempest-ProjectMemberTests-883983225 None] Lock "cinder-bb6dc9c7-9710-4226-a2cd-31bc1ba2896d-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:14 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bcdcae16-5df8-4955-a206-0abed88c0a06 1073741824" returned: 0 in 0.584s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bcdcae16-5df8-4955-a206-0abed88c0a06 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:14 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bcdcae16-5df8-4955-a206-0abed88c0a06 Sep 19 00:04:14 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:14 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (da7b9320-24d1-4c86-8f0c-1ba268e69cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7816d5-f563-431d-82c6-60f0b624b2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bcdcae16-5df8-4955-a206-0abed88c0a06" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.373s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7816d5-f563-431d-82c6-60f0b624b2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-231516402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04e127d-1dda-4d72-b4fc-4b0037d312a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:15Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ad7674-60e7-4294-ac96-78c1bccf5bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ad7674-60e7-4294-ac96-78c1bccf5bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9fc05f-8aa4-40f0-bad8-b00ef535dcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9fc05f-8aa4-40f0-bad8-b00ef535dcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a04e127d-1dda-4d72-b4fc-4b0037d312a5', 'volume_name': 'volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d36779-795a-4306-a8ad-bea112a9874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d36779-795a-4306-a8ad-bea112a9874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67f55b3-87d9-4c4a-b123-444d36ff4258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Volume a04e127d-1dda-4d72-b4fc-4b0037d312a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5', 'volume_size': 1} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f856d8-e850-4502-9bf7-d2001a2b5cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdcae16-5df8-4955-a206-0abed88c0a06', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec0e186-a9fb-4944-a8a5-2bc52d889b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] Creating offline snapshot 6c786954-b8fa-443c-9e6b-1650f1713a8c of volume c591ec3b-ac9a-426e-ac56-5b91aa713439 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:04:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Volume volume-bcdcae16-5df8-4955-a206-0abed88c0a06 (bcdcae16-5df8-4955-a206-0abed88c0a06): created successfully Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec0e186-a9fb-4944-a8a5-2bc52d889b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Flow 'volume_create_manager' (e71bd3c8-8b07-4af6-b431-8a72815d55ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c448ed1-c0de-4060-94d9-199b92b26786]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b2b5ab46-eeca-4ba2-9c84-c92c2302c954 tempest-ProjectReaderTests-2091490680 None] Created volume successfully. Sep 19 00:04:14 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 Sep 19 00:04:14 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Flow 'volume_create_manager' (78f55f26-b08e-4bcc-a593-30d186c19fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37278b6-d2f4-4b1f-a81b-45fbc846a006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37278b6-d2f4-4b1f-a81b-45fbc846a006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2014720520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cb9b0b-934a-4868-addd-96f6b903bf2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8848887330d9490986713627244034cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:15Z,use_quota=True,user_id='b7e56a4dbcc3443eb637932aecf82bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbb9c3a-e3a7-4cf4-b868-ec01e0a4cd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbb9c3a-e3a7-4cf4-b868-ec01e0a4cd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cd27b4-c554-49b7-8a68-51dbe34ccb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cd27b4-c554-49b7-8a68-51dbe34ccb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07cb9b0b-934a-4868-addd-96f6b903bf2d', 'volume_name': 'volume-07cb9b0b-934a-4868-addd-96f6b903bf2d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5409b3-e24e-4629-9640-690150800a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5409b3-e24e-4629-9640-690150800a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595a50ce-238e-4f53-9bd9-ddffa86c4b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:15 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Volume 07cb9b0b-934a-4868-addd-96f6b903bf2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07cb9b0b-934a-4868-addd-96f6b903bf2d', 'volume_size': 1} Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:15 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439" returned: 0 in 0.383s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:15 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c 1G Sep 19 00:04:15 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:15 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c 1G" returned: 0 in 0.428s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:15 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c Sep 19 00:04:15 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:15 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c" returned: 0 in 0.327s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:15 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c is being set with open permissions: ugo+rw Sep 19 00:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:15 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c Sep 19 00:04:15 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Acquiring lock "cinder-bcdcae16-5df8-4955-a206-0abed88c0a06-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Lock "cinder-bcdcae16-5df8-4955-a206-0abed88c0a06-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Acquiring lock "cinder-quobyte-bcdcae16-5df8-4955-a206-0abed88c0a06" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Lock "cinder-quobyte-bcdcae16-5df8-4955-a206-0abed88c0a06" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c549dc-4a6e-4b56-9b5b-1c3f82e3d8b7]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bcdcae16-5df8-4955-a206-0abed88c0a06 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:16 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:16 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bcdcae16-5df8-4955-a206-0abed88c0a06 Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c" returned: 0 in 0.258s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:16 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:16 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.info Sep 19 00:04:16 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:16 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bcdcae16-5df8-4955-a206-0abed88c0a06" returned: 0 in 0.371s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bcdcae16-5df8-4955-a206-0abed88c0a06 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:16 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bcdcae16-5df8-4955-a206-0abed88c0a06 Sep 19 00:04:16 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:16 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.info" returned: 0 in 0.275s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:16 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.info is being set with open permissions: ugo+rw Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:16 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.info Sep 19 00:04:16 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:16 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-bcdcae16-5df8-4955-a206-0abed88c0a06" returned: 0 in 0.263s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Lock "cinder-quobyte-bcdcae16-5df8-4955-a206-0abed88c0a06" released by "delete_volume" :: held 0.680s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:16 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.info" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.058s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-231516402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04e127d-1dda-4d72-b4fc-4b0037d312a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:15Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Creating volume a04e127d-1dda-4d72-b4fc-4b0037d312a5 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:16 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:16 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 1073741824 Sep 19 00:04:16 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Created reservations ['ac25e699-ae4d-482f-a537-23e7e9af91e8', 'fe1f9d0e-f001-44d9-ad9d-18d2ce3a872f', '6d1607ed-e982-48eb-9539-69b9ee349a51', '222c74a2-1c84-42c4-a5a7-b3f58122c6e8'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2dc31cfb-59e6-48f1-9899-9fad74939cff tempest-ProjectReaderTests-902715026 None] Create snapshot completed successfully Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:16 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:16 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:17 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.262s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Deleted volume successfully. Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d86020f6-5b50-4f8f-b19a-b089b435986e tempest-ProjectReaderTests-2091490680 None] Lock "cinder-bcdcae16-5df8-4955-a206-0abed88c0a06-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:17 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 1073741824" returned: 0 in 0.502s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:17 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 Sep 19 00:04:17 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-6c786954-b8fa-443c-9e6b-1650f1713a8c-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Lock "cinder-6c786954-b8fa-443c-9e6b-1650f1713a8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-c591ec3b-ac9a-426e-ac56-5b91aa713439" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-c591ec3b-ac9a-426e-ac56-5b91aa713439" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-6c786954-b8fa-443c-9e6b-1650f1713a8c" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-6c786954-b8fa-443c-9e6b-1650f1713a8c" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Deleting offline snapshot 6c786954-b8fa-443c-9e6b-1650f1713a8c of volume c591ec3b-ac9a-426e-ac56-5b91aa713439 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:04:17 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] snapshot_file for this snap is: volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5" returned: 0 in 0.330s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.652s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2014720520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cb9b0b-934a-4868-addd-96f6b903bf2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8848887330d9490986713627244034cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:15Z,use_quota=True,user_id='b7e56a4dbcc3443eb637932aecf82bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Creating volume 07cb9b0b-934a-4868-addd-96f6b903bf2d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:17 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd55812-17c0-4e25-8859-0847b9d06461]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:17 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d 1073741824 Sep 19 00:04:17 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67f55b3-87d9-4c4a-b123-444d36ff4258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84774e42-e6de-4e0d-a4e2-c609d4041939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:17 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Volume volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 (a04e127d-1dda-4d72-b4fc-4b0037d312a5): created successfully Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84774e42-e6de-4e0d-a4e2-c609d4041939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (da7b9320-24d1-4c86-8f0c-1ba268e69cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Flow 'volume_create_manager' (46da9b93-9fff-4bbc-9550-db827fd0d2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4dff520-392a-4c7a-9896-b1dceb8071cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b7d16881-3ef7-4377-98bb-34442809d914 tempest-ProjectMemberTests-883983225 None] Created volume successfully. Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4dff520-392a-4c7a-9896-b1dceb8071cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156079512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d52e099-439b-4f57-8fdf-9e5cdf01b8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bfa3dcd2aa4c2ab2c561c5da1ba0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:18Z,use_quota=True,user_id='ac7ae404621d4a30beab59704fdb4a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:17 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c Sep 19 00:04:17 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a08789-a1ee-4e2f-91a4-bb2563bfaf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a08789-a1ee-4e2f-91a4-bb2563bfaf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62284ef2-e071-49d4-b04a-76b03b1e719f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62284ef2-e071-49d4-b04a-76b03b1e719f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d52e099-439b-4f57-8fdf-9e5cdf01b8f8', 'volume_name': 'volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3962a7-0537-478b-93ca-f144f1491ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3962a7-0537-478b-93ca-f144f1491ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4aacf4-4e5b-4046-b833-38ba84b4db7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:17 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Volume 6d52e099-439b-4f57-8fdf-9e5cdf01b8f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8', 'volume_size': 1} Sep 19 00:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:18 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c" returned: 0 in 0.399s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c591ec3b-ac9a-426e-ac56-5b91aa713439(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:04:18 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d 1073741824" returned: 0 in 0.447s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0753c7-f78f-4156-9529-b1d1827c59b2]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:18 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d Sep 19 00:04:18 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:18 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 Sep 19 00:04:18 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:18 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d" returned: 0 in 0.252s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.584s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156079512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d52e099-439b-4f57-8fdf-9e5cdf01b8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2bfa3dcd2aa4c2ab2c561c5da1ba0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:18Z,use_quota=True,user_id='ac7ae404621d4a30beab59704fdb4a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Creating volume 6d52e099-439b-4f57-8fdf-9e5cdf01b8f8 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:18 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595a50ce-238e-4f53-9bd9-ddffa86c4b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07cb9b0b-934a-4868-addd-96f6b903bf2d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:18 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8 1073741824 Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1a94cb-34ac-471c-8f7f-aac9eccaa94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:18 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:18 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Volume volume-07cb9b0b-934a-4868-addd-96f6b903bf2d (07cb9b0b-934a-4868-addd-96f6b903bf2d): created successfully Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1a94cb-34ac-471c-8f7f-aac9eccaa94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Flow 'volume_create_manager' (78f55f26-b08e-4bcc-a593-30d186c19fa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cf638bc9-6740-4ba8-b195-5a82a1e84a26 tempest-CinderUnicodeTest-1342351950 None] Created volume successfully. Sep 19 00:04:18 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439" returned: 0 in 0.382s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:18 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c Sep 19 00:04:18 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:18 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:18 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8 1073741824" returned: 0 in 0.486s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:18 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c Sep 19 00:04:18 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:19 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8 Sep 19 00:04:19 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:19 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439.6c786954-b8fa-443c-9e6b-1650f1713a8c" returned: 0 in 0.288s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-6c786954-b8fa-443c-9e6b-1650f1713a8c" released by "_delete_snapshot" :: held 1.629s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-c591ec3b-ac9a-426e-ac56-5b91aa713439" released by "delete_snapshot" :: held 1.710s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:19 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8" returned: 0 in 0.282s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.247s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4aacf4-4e5b-4046-b833-38ba84b4db7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8975cdc5-c4a9-46ba-a74d-439ea84604ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] Creating offline snapshot ba76cfbf-e767-4469-a175-5c8bfde5b179 of volume a04e127d-1dda-4d72-b4fc-4b0037d312a5 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:04:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Volume volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8 (6d52e099-439b-4f57-8fdf-9e5cdf01b8f8): created successfully Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8975cdc5-c4a9-46ba-a74d-439ea84604ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Flow 'volume_create_manager' (46da9b93-9fff-4bbc-9550-db827fd0d2df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8f63b3-db34-4579-9110-05c83dcdb531]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fb2349a0-51b8-4475-b9d0-cbeb628f3770 tempest-ProjectReaderTests-2091490680 None] Created volume successfully. Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Created reservations ['4edc54e2-0bf0-447e-95a8-13bfe3b5479f', 'b7432d50-f70a-40f8-9173-70301c0af136', 'd35e38bd-48d9-4a1d-b3c6-14696578c09d', '91236961-b109-4bc6-a384-ca071c34e0ab'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Delete snapshot completed successfully. Sep 19 00:04:19 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 Sep 19 00:04:19 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-628869c7-ff00-446d-a153-98b32056ed1d tempest-ProjectReaderTests-902715026 None] Lock "cinder-6c786954-b8fa-443c-9e6b-1650f1713a8c-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-c591ec3b-ac9a-426e-ac56-5b91aa713439-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Lock "cinder-c591ec3b-ac9a-426e-ac56-5b91aa713439-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-c591ec3b-ac9a-426e-ac56-5b91aa713439" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-c591ec3b-ac9a-426e-ac56-5b91aa713439" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:19 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "cinder-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5" returned: 0 in 0.470s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1701cf-0196-4100-8feb-b91ad5849b30]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:19 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 1G Sep 19 00:04:19 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Lock "cinder-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "cinder-quobyte-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Lock "cinder-quobyte-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[840b5ec8-d4fa-4e50-a423-80063daf7ef8]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:19 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 Sep 19 00:04:19 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:20 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8 Sep 19 00:04:20 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:20 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 1G" returned: 0 in 0.444s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:20 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439" returned: 0 in 0.457s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:20 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 Sep 19 00:04:20 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:20 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439 Sep 19 00:04:20 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:20 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8" returned: 0 in 0.394s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:20 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8 Sep 19 00:04:20 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:20 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-c591ec3b-ac9a-426e-ac56-5b91aa713439" returned: 0 in 0.256s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-c591ec3b-ac9a-426e-ac56-5b91aa713439" released by "delete_volume" :: held 0.799s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:20 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:20 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 is being set with open permissions: ugo+rw Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:20 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 Sep 19 00:04:20 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:20 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Created reservations ['77354725-1ebe-4580-a2ab-213b1dd9ce91', 'deae28fe-1fde-493d-98ab-54275e0dbda8', 'db74ce54-90cb-4ec7-a28c-846270b6b482', 'd7b30798-fc8a-46cb-9ada-a9efd18504fc'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8" returned: 0 in 0.289s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Lock "cinder-quobyte-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8" released by "delete_volume" :: held 0.740s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Created reservations ['97cf9c8c-e7c9-4cb6-a9b1-2ac6cd79b6ae', '9a8c34bd-86ff-4773-b269-a9247276c7b6', 'd022fcdd-acd8-4951-ba55-fdf988d15ed4', 'f76620c0-f835-421e-949d-238b09e48f17'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:20 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:20 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:20 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179" returned: 0 in 0.300s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:20 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:20 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:20 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.info Sep 19 00:04:20 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:21 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.366s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Deleted volume successfully. Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d3d8636d-4c2f-474c-b107-d34fc7ec2f06 tempest-ProjectReaderTests-902715026 None] Lock "cinder-c591ec3b-ac9a-426e-ac56-5b91aa713439-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:21 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:21 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.436s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.info" returned: 0 in 0.384s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:21 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.info is being set with open permissions: ugo+rw Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:21 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Deleted volume successfully. Sep 19 00:04:21 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:21 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.info Sep 19 00:04:21 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2f1d3c9f-b65e-4d56-9b61-bbc427cf3cd3 tempest-ProjectReaderTests-2091490680 None] Lock "cinder-6d52e099-439b-4f57-8fdf-9e5cdf01b8f8-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Flow 'volume_create_manager' (c060af97-b281-431e-9eaa-0ac75c4c1c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b49543-2202-44f0-9137-cfaea7b41f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b49543-2202-44f0-9137-cfaea7b41f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880378796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd085fe-8ac5-43f5-b135-99775e2f2e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c17acac06e342d892261e5fe98c16a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:21Z,use_quota=True,user_id='5851a32bb5c04787b329a9e874b8db68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6430f8b0-a695-4a31-9c2e-9e4ecbe3fdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6430f8b0-a695-4a31-9c2e-9e4ecbe3fdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17655dd8-ebd9-41a6-b52b-7b49ead67388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17655dd8-ebd9-41a6-b52b-7b49ead67388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd085fe-8ac5-43f5-b135-99775e2f2e1e', 'volume_name': 'volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f697f9-7328-4749-8467-bbb73279b70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f697f9-7328-4749-8467-bbb73279b70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5e8025-1811-45cc-913f-38ca7a2b623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Volume 4bd085fe-8ac5-43f5-b135-99775e2f2e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e', 'volume_size': 1} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:21 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:21 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.info" returned: 0 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.267s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 29 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] Creating offline snapshot 8560dbe5-4300-415a-b3ef-ff282f8a4229 of volume 07cb9b0b-934a-4868-addd-96f6b903bf2d {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:04:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-19202cc1-e892-4420-ab2f-3c02a71ca37e tempest-ProjectMemberTests-883983225 None] Create snapshot completed successfully Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2038fb03-c937-4d83-9d48-c9df9844a067]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:21 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d Sep 19 00:04:21 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:22 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d" returned: 0 in 0.420s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:22 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 1G Sep 19 00:04:22 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-ba76cfbf-e767-4469-a175-5c8bfde5b179-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Lock "cinder-ba76cfbf-e767-4469-a175-5c8bfde5b179-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-a04e127d-1dda-4d72-b4fc-4b0037d312a5" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-a04e127d-1dda-4d72-b4fc-4b0037d312a5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-ba76cfbf-e767-4469-a175-5c8bfde5b179" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-ba76cfbf-e767-4469-a175-5c8bfde5b179" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Deleting offline snapshot ba76cfbf-e767-4469-a175-5c8bfde5b179 of volume a04e127d-1dda-4d72-b4fc-4b0037d312a5 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] snapshot_file for this snap is: volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ea392e-1f21-4330-9e8c-abd8f182c7bb]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:22 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 Sep 19 00:04:22 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:22 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 1G" returned: 0 in 0.575s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07cb9b0b-934a-4868-addd-96f6b903bf2d -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:22 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07cb9b0b-934a-4868-addd-96f6b903bf2d -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 Sep 19 00:04:22 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:22 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179" returned: 0 in 0.458s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e3da29-1fea-4fd8-8dca-323b18ac80ba]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:23 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 Sep 19 00:04:23 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:23 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07cb9b0b-934a-4868-addd-96f6b903bf2d -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229" returned: 0 in 0.359s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:23 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 is being set with open permissions: ugo+rw Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:23 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 Sep 19 00:04:23 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:23 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5" returned: 0 in 0.396s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:23 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 Sep 19 00:04:23 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:23 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229" returned: 0 in 0.273s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:23 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.info Sep 19 00:04:23 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:23 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.info" returned: 0 in 0.259s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:23 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.info is being set with open permissions: ugo+rw Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:23 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.info Sep 19 00:04:23 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:23 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179" returned: 0 in 0.395s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:23 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179 Sep 19 00:04:23 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:23 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.info" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.297s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880378796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd085fe-8ac5-43f5-b135-99775e2f2e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c17acac06e342d892261e5fe98c16a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:21Z,use_quota=True,user_id='5851a32bb5c04787b329a9e874b8db68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Creating volume 4bd085fe-8ac5-43f5-b135-99775e2f2e1e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:23 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:23 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5.ba76cfbf-e767-4469-a175-5c8bfde5b179" returned: 0 in 0.261s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:23 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e 1073741824 Sep 19 00:04:23 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-ba76cfbf-e767-4469-a175-5c8bfde5b179" released by "_delete_snapshot" :: held 1.673s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-a04e127d-1dda-4d72-b4fc-4b0037d312a5" released by "delete_snapshot" :: held 1.705s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0b1af52e-c4e9-4146-b4e5-0cb9cfd8c8e5 tempest-CinderUnicodeTest-1342351950 None] Create snapshot completed successfully Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Created reservations ['7fd7a650-1570-454e-bd73-ad01ae138a00', '9c7fcdeb-bd1f-4813-8499-4be76e0c4100', 'df391f43-8dbb-46b9-85da-2cfd6b99c6c1', 'ab780da3-ce84-49f3-8b78-1326628049a5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Delete snapshot completed successfully. Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-05fbf4b8-d363-4225-9bc9-7dc7964f84e4 tempest-ProjectMemberTests-883983225 None] Lock "cinder-ba76cfbf-e767-4469-a175-5c8bfde5b179-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:24 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e 1073741824" returned: 0 in 0.427s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-a04e127d-1dda-4d72-b4fc-4b0037d312a5-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:24 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e Sep 19 00:04:24 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Lock "cinder-a04e127d-1dda-4d72-b4fc-4b0037d312a5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-a04e127d-1dda-4d72-b4fc-4b0037d312a5" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-a04e127d-1dda-4d72-b4fc-4b0037d312a5" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f1ba2f-ce35-47c2-8348-ac56125116ad]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:24 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 Sep 19 00:04:24 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:24 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e" returned: 0 in 0.283s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5e8025-1811-45cc-913f-38ca7a2b623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcff4ee-29d2-4114-99c4-3eafa81e92a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "cinder-8560dbe5-4300-415a-b3ef-ff282f8a4229-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:24 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Volume volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e (4bd085fe-8ac5-43f5-b135-99775e2f2e1e): created successfully Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcff4ee-29d2-4114-99c4-3eafa81e92a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Flow 'volume_create_manager' (c060af97-b281-431e-9eaa-0ac75c4c1c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-8560dbe5-4300-415a-b3ef-ff282f8a4229-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "cinder-quobyte-07cb9b0b-934a-4868-addd-96f6b903bf2d" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-quobyte-07cb9b0b-934a-4868-addd-96f6b903bf2d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "cinder-quobyte-8560dbe5-4300-415a-b3ef-ff282f8a4229" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ffa51de5-9b07-490f-9bbc-e39f09620714 tempest-ProjectReaderTests-902715026 None] Created volume successfully. Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-quobyte-8560dbe5-4300-415a-b3ef-ff282f8a4229" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Deleting offline snapshot 8560dbe5-4300-415a-b3ef-ff282f8a4229 of volume 07cb9b0b-934a-4868-addd-96f6b903bf2d {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] snapshot_file for this snap is: volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[420528fe-44b9-438a-8b15-280e2a747921]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:24 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:24 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 Sep 19 00:04:24 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5" returned: 0 in 0.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:25 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5 Sep 19 00:04:25 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:25 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:25 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a04e127d-1dda-4d72-b4fc-4b0037d312a5" returned: 0 in 0.259s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07cb9b0b-934a-4868-addd-96f6b903bf2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-a04e127d-1dda-4d72-b4fc-4b0037d312a5" released by "delete_volume" :: held 0.744s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[397612df-dfb5-4118-aa84-e709c3809385]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Created reservations ['fb2ac0d4-271a-4a01-9be7-cf2fdab1f663', '3da1d742-6cba-402b-933c-6915a2688714', '5126a5eb-32be-4dba-9950-87898f7ea2fb', 'd102879e-ffea-4c79-81b8-18de4bf7fba7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:25 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d Sep 19 00:04:25 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:25 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:25 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:25 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.258s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Deleted volume successfully. Sep 19 00:04:25 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d" returned: 0 in 0.400s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d90b8a72-a655-4662-a73c-446235265580 tempest-ProjectMemberTests-883983225 None] Lock "cinder-a04e127d-1dda-4d72-b4fc-4b0037d312a5-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:25 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 Sep 19 00:04:25 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:26 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229" returned: 0 in 0.404s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:26 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229 Sep 19 00:04:26 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (7ba2eafa-a140-4975-a12c-1d6b614b65b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc86a59a-117b-4eac-b731-ff99cc72dcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc86a59a-117b-4eac-b731-ff99cc72dcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692413767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca26aba-ba40-4c15-a740-a60996d433db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:26Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d928b30-d79d-45ff-9196-37234999c174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d928b30-d79d-45ff-9196-37234999c174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66dd388-2f3b-4143-bfbd-36a30abf42e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66dd388-2f3b-4143-bfbd-36a30abf42e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ca26aba-ba40-4c15-a740-a60996d433db', 'volume_name': 'volume-1ca26aba-ba40-4c15-a740-a60996d433db', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbb1894-be45-4597-9a19-99109accca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbb1894-be45-4597-9a19-99109accca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6ef60a-9f14-400b-8169-1d4d8af11561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Volume 1ca26aba-ba40-4c15-a740-a60996d433db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ca26aba-ba40-4c15-a740-a60996d433db', 'volume_size': 1} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:26 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] Creating offline snapshot 846a20bf-a02e-49c1-b8f2-8a571577a1a2 of volume 4bd085fe-8ac5-43f5-b135-99775e2f2e1e {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d.8560dbe5-4300-415a-b3ef-ff282f8a4229" returned: 0 in 0.282s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[819e02a6-ec37-46cf-acd4-66c5d4e57269]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-quobyte-8560dbe5-4300-415a-b3ef-ff282f8a4229" released by "_delete_snapshot" :: held 1.597s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-quobyte-07cb9b0b-934a-4868-addd-96f6b903bf2d" released by "delete_snapshot" :: held 1.624s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Created reservations ['55b3e024-24f2-4573-94e8-6865a4c9055d', '46e6a9bf-3d1d-4b47-9e92-817510b6160a', '9293f3f2-cf22-4225-b1ec-53e838f89def', '7ba0405f-3276-403d-b41f-68a537a81a1b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:26 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e Sep 19 00:04:26 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Delete snapshot completed successfully. Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-032074a7-d1ba-4481-a265-2addd4321231 tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-8560dbe5-4300-415a-b3ef-ff282f8a4229-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:26 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e" returned: 0 in 0.381s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:26 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 1G Sep 19 00:04:26 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "cinder-07cb9b0b-934a-4868-addd-96f6b903bf2d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-07cb9b0b-934a-4868-addd-96f6b903bf2d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "cinder-quobyte-07cb9b0b-934a-4868-addd-96f6b903bf2d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-quobyte-07cb9b0b-934a-4868-addd-96f6b903bf2d" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb993022-8e86-469c-981c-fcd8922556d1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:27 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 1G" returned: 0 in 0.466s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:27 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 Sep 19 00:04:27 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:27 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d Sep 19 00:04:27 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:27 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2" returned: 0 in 0.300s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:27 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 is being set with open permissions: ugo+rw Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:27 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d" returned: 0 in 0.382s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:27 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 Sep 19 00:04:27 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:27 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d Sep 19 00:04:27 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:27 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2" returned: 0 in 0.248s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:27 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-07cb9b0b-934a-4868-addd-96f6b903bf2d" returned: 0 in 0.261s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:27 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.info Sep 19 00:04:27 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-quobyte-07cb9b0b-934a-4868-addd-96f6b903bf2d" released by "delete_volume" :: held 0.714s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Created reservations ['c08ed1bd-653a-40db-8207-8b13aaefe5ed', '780affc0-5474-4c55-b87f-bbcd5846aa7a', '5df1bba8-f042-4ef9-b7b1-76e21b67e384', 'b6531433-3c49-4c2a-b84f-863c7b4474ff'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:28 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:28 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:28 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.info" returned: 0 in 0.266s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:28 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.info is being set with open permissions: ugo+rw Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:28 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.info Sep 19 00:04:28 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "cinder-a57a0d79-4486-4bd8-a153-3cc822b6ce7e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-a57a0d79-4486-4bd8-a153-3cc822b6ce7e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:28 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Deleted volume successfully. Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "cinder-quobyte-a57a0d79-4486-4bd8-a153-3cc822b6ce7e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cc449b93-cb97-44f4-9d87-b51eb4695db7 tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-07cb9b0b-934a-4868-addd-96f6b903bf2d-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-quobyte-a57a0d79-4486-4bd8-a153-3cc822b6ce7e" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25b0d75-091b-428f-b1ac-57bee3e6c73f]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:28 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.info" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.084s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692413767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca26aba-ba40-4c15-a740-a60996d433db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:26Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Creating volume 1ca26aba-ba40-4c15-a740-a60996d433db {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:28 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:28 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e Sep 19 00:04:28 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:28 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db 1073741824 Sep 19 00:04:28 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2392a2db-e678-4052-be35-bbe0fdcd66d1 tempest-ProjectReaderTests-902715026 None] Create snapshot completed successfully Sep 19 00:04:28 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e" returned: 0 in 0.400s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:28 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e Sep 19 00:04:28 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:28 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db 1073741824" returned: 0 in 0.453s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:28 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db Sep 19 00:04:28 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:29 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a57a0d79-4486-4bd8-a153-3cc822b6ce7e" returned: 0 in 0.270s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-quobyte-a57a0d79-4486-4bd8-a153-3cc822b6ce7e" released by "delete_volume" :: held 0.716s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Created reservations ['5e0ef958-8f70-4c28-b05c-8536c6535156', '3a1f8998-5120-4c8e-b26e-60cfa06493c3', '41a5c255-6117-46e9-9bb0-d5f0e4be6032', 'dbc58f39-a13f-4854-8d8f-f40e6cf1752a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-846a20bf-a02e-49c1-b8f2-8a571577a1a2-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:29 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:29 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:29 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db" returned: 0 in 0.302s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Lock "cinder-846a20bf-a02e-49c1-b8f2-8a571577a1a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-4bd085fe-8ac5-43f5-b135-99775e2f2e1e" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-4bd085fe-8ac5-43f5-b135-99775e2f2e1e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-846a20bf-a02e-49c1-b8f2-8a571577a1a2" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6ef60a-9f14-400b-8169-1d4d8af11561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca26aba-ba40-4c15-a740-a60996d433db', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfb7625-e653-4f38-a636-8c7ea4e5e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-846a20bf-a02e-49c1-b8f2-8a571577a1a2" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Deleting offline snapshot 846a20bf-a02e-49c1-b8f2-8a571577a1a2 of volume 4bd085fe-8ac5-43f5-b135-99775e2f2e1e {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] snapshot_file for this snap is: volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:04:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Volume volume-1ca26aba-ba40-4c15-a740-a60996d433db (1ca26aba-ba40-4c15-a740-a60996d433db): created successfully Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfb7625-e653-4f38-a636-8c7ea4e5e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (7ba2eafa-a140-4975-a12c-1d6b614b65b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc69698-0674-40ba-a171-3d4d7553ac5e]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c1ea0567-77dc-4f33-8587-3750c300f29e tempest-ProjectMemberTests-883983225 None] Created volume successfully. Sep 19 00:04:29 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 Sep 19 00:04:29 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:29 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.338s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Deleted volume successfully. Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-42ecdd50-c504-434b-95bb-081b398bed0b tempest-CinderUnicodeTest-1342351950 None] Lock "cinder-a57a0d79-4486-4bd8-a153-3cc822b6ce7e-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:29 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2" returned: 0 in 0.440s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[76978e2c-4c07-43a4-96ce-5474f4d00790]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:29 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e Sep 19 00:04:29 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:30 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e" returned: 0 in 0.401s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:30 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 Sep 19 00:04:30 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] Creating offline snapshot e424d929-152a-42ed-bd80-4eff85fec4cc of volume 1ca26aba-ba40-4c15-a740-a60996d433db {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:04:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bf5639-e597-46b8-b43f-71e511193c83]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:30 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2" returned: 0 in 0.496s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:30 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2 Sep 19 00:04:30 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:30 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db Sep 19 00:04:30 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:31 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e.846a20bf-a02e-49c1-b8f2-8a571577a1a2" returned: 0 in 0.273s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-846a20bf-a02e-49c1-b8f2-8a571577a1a2" released by "_delete_snapshot" :: held 1.756s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-4bd085fe-8ac5-43f5-b135-99775e2f2e1e" released by "delete_snapshot" :: held 1.802s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:31 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db" returned: 0 in 0.411s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Created reservations ['315fb3e3-f70c-4d44-ab1e-6ae2434c49db', '92807549-589b-4bf6-a628-40892f8c2b17', 'f35d2d38-686c-4044-b9e7-dad54be1d197', 'fe287096-897d-4859-b68b-c6cf439e60d1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:31 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc 1G Sep 19 00:04:31 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Delete snapshot completed successfully. Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-494bca51-e98b-42cc-8af2-da18055bbf85 tempest-ProjectReaderTests-902715026 None] Lock "cinder-846a20bf-a02e-49c1-b8f2-8a571577a1a2-delete_snapshot" released by "delete_snapshot" :: held 1.978s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-4bd085fe-8ac5-43f5-b135-99775e2f2e1e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Lock "cinder-4bd085fe-8ac5-43f5-b135-99775e2f2e1e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Acquiring lock "cinder-quobyte-4bd085fe-8ac5-43f5-b135-99775e2f2e1e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-4bd085fe-8ac5-43f5-b135-99775e2f2e1e" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09ed20e-65cf-40da-95c9-fcbe78221fdf]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:31 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc 1G" returned: 0 in 0.512s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca26aba-ba40-4c15-a740-a60996d433db -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:31 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca26aba-ba40-4c15-a740-a60996d433db -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc Sep 19 00:04:31 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:31 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e Sep 19 00:04:31 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:31 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e" returned: 0 in 0.417s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:31 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca26aba-ba40-4c15-a740-a60996d433db -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc" returned: 0 in 0.348s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:31 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc is being set with open permissions: ugo+rw Sep 19 00:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:32 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e Sep 19 00:04:32 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:32 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc Sep 19 00:04:32 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:32 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4bd085fe-8ac5-43f5-b135-99775e2f2e1e" returned: 0 in 0.276s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:32 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Lock "cinder-quobyte-4bd085fe-8ac5-43f5-b135-99775e2f2e1e" released by "delete_volume" :: held 0.776s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:32 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.info Sep 19 00:04:32 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Created reservations ['5e1f129c-8378-4cb8-b9a6-7238662ab6fd', 'fdf86fcb-afcf-439e-94b1-3e2d68f0719a', '95062925-0eb8-48f5-a2ba-b7d67c254415', 'ecc57556-5ff0-4fac-99d5-0a7327eff286'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:32 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:32 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:32 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.info" returned: 0 in 0.292s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:32 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.info is being set with open permissions: ugo+rw Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:32 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.info Sep 19 00:04:32 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:32 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.325s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Deleted volume successfully. Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-aa05d119-f335-4a04-b562-5f540ec4f15e tempest-ProjectReaderTests-902715026 None] Lock "cinder-4bd085fe-8ac5-43f5-b135-99775e2f2e1e-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:32 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.info" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f1b72899-8a51-4182-bdb7-ab2ec4d34cbe tempest-ProjectMemberTests-883983225 None] Create snapshot completed successfully Sep 19 00:04:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-e424d929-152a-42ed-bd80-4eff85fec4cc-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Lock "cinder-e424d929-152a-42ed-bd80-4eff85fec4cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-1ca26aba-ba40-4c15-a740-a60996d433db" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-1ca26aba-ba40-4c15-a740-a60996d433db" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-e424d929-152a-42ed-bd80-4eff85fec4cc" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-e424d929-152a-42ed-bd80-4eff85fec4cc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Deleting offline snapshot e424d929-152a-42ed-bd80-4eff85fec4cc of volume 1ca26aba-ba40-4c15-a740-a60996d433db {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] snapshot_file for this snap is: volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:04:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ec24d8-eae5-4447-a535-3c469a2a541b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:34 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc Sep 19 00:04:34 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:34 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc" returned: 0 in 0.430s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ca26aba-ba40-4c15-a740-a60996d433db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:04:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1d54ed-75bd-4b1e-9e3f-c5278ba87bf1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:34 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db Sep 19 00:04:34 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:34 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db" returned: 0 in 0.430s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:34 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc Sep 19 00:04:34 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:35 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc" returned: 0 in 0.457s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:35 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc Sep 19 00:04:35 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:35 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db.e424d929-152a-42ed-bd80-4eff85fec4cc" returned: 0 in 0.284s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-e424d929-152a-42ed-bd80-4eff85fec4cc" released by "_delete_snapshot" :: held 1.738s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-1ca26aba-ba40-4c15-a740-a60996d433db" released by "delete_snapshot" :: held 1.767s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:35 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Created reservations ['96ca1920-4e07-4690-8cb3-a9dd3fb340c1', '22981cc0-4d77-4226-97e8-3b2589ffe48b', '59420280-b986-4390-958a-e3a99030102f', 'ea32805e-c8d7-4666-9cbe-3e30ab2ef5f1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Delete snapshot completed successfully. Sep 19 00:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-347d0799-6031-4f0e-b7d9-4d1e942ae9c4 tempest-ProjectMemberTests-883983225 None] Lock "cinder-e424d929-152a-42ed-bd80-4eff85fec4cc-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-1ca26aba-ba40-4c15-a740-a60996d433db-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Lock "cinder-1ca26aba-ba40-4c15-a740-a60996d433db-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-1ca26aba-ba40-4c15-a740-a60996d433db" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-1ca26aba-ba40-4c15-a740-a60996d433db" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[766cf153-0f54-4b3e-aac4-6abc52e4b15b]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:36 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db Sep 19 00:04:36 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:36 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db" returned: 0 in 0.392s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:36 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db Sep 19 00:04:36 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:36 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-1ca26aba-ba40-4c15-a740-a60996d433db" returned: 0 in 0.259s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-1ca26aba-ba40-4c15-a740-a60996d433db" released by "delete_volume" :: held 0.735s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:36 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Created reservations ['4f6fef06-7531-41da-9d76-1a4695388cec', 'dbb43b9e-239c-4a8f-ace6-e3e9239fcce3', '63e3484b-c908-442b-8119-216e68bbf4c5', 'e7dbb088-77b0-4d88-9563-c2ad6f271417'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:37 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:37 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:37 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.266s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Deleted volume successfully. Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1d9b6c0-e33e-4b1f-86d2-5669d85b9779 tempest-ProjectMemberTests-883983225 None] Lock "cinder-1ca26aba-ba40-4c15-a740-a60996d433db-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (e99f4575-a1b7-46f5-9dbd-174d9209d813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bf5279-988f-4746-a1dd-8f6bb74320fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82bf5279-988f-4746-a1dd-8f6bb74320fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-529401636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4393a5bc-faf4-494c-96c9-b421ea344f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:38Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726dd51a-efe2-4e37-9c46-93f86fbe39b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726dd51a-efe2-4e37-9c46-93f86fbe39b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0f3087-1418-4840-88d8-b4bd19e9b3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0f3087-1418-4840-88d8-b4bd19e9b3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4393a5bc-faf4-494c-96c9-b421ea344f5d', 'volume_name': 'volume-4393a5bc-faf4-494c-96c9-b421ea344f5d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4977c329-2968-440b-a277-9715553d1d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4977c329-2968-440b-a277-9715553d1d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7fddf6-2a57-46ec-8485-60c3fd7816fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:37 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Volume 4393a5bc-faf4-494c-96c9-b421ea344f5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4393a5bc-faf4-494c-96c9-b421ea344f5d', 'volume_size': 1} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-529401636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4393a5bc-faf4-494c-96c9-b421ea344f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d043d8ded452ca18f57252bff694d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:38Z,use_quota=True,user_id='8a45aa620d5e4219b21052198f10968c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Creating volume 4393a5bc-faf4-494c-96c9-b421ea344f5d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:37 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:37 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d 1073741824 Sep 19 00:04:37 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:38 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d 1073741824" returned: 0 in 0.509s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:38 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d Sep 19 00:04:38 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:38 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d" returned: 0 in 0.256s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7fddf6-2a57-46ec-8485-60c3fd7816fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4393a5bc-faf4-494c-96c9-b421ea344f5d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd74a21-cadf-48c9-8509-82423a964c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:38 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Volume volume-4393a5bc-faf4-494c-96c9-b421ea344f5d (4393a5bc-faf4-494c-96c9-b421ea344f5d): created successfully Sep 19 00:04:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd74a21-cadf-48c9-8509-82423a964c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Flow 'volume_create_manager' (e99f4575-a1b7-46f5-9dbd-174d9209d813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0de89610-a94d-438a-b135-e7ffedb8bb27 tempest-ProjectMemberTests-883983225 None] Created volume successfully. Sep 19 00:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] Creating offline snapshot 44651dab-4d25-455a-a25b-5192e3a158d7 of volume 4393a5bc-faf4-494c-96c9-b421ea344f5d {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:04:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[140361ea-0156-47fd-ab06-a2a9da17b2aa]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:40 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d Sep 19 00:04:40 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:40 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d" returned: 0 in 0.401s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:40 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 1G Sep 19 00:04:40 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:41 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 1G" returned: 0 in 0.387s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4393a5bc-faf4-494c-96c9-b421ea344f5d -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:41 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4393a5bc-faf4-494c-96c9-b421ea344f5d -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 Sep 19 00:04:41 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:41 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4393a5bc-faf4-494c-96c9-b421ea344f5d -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7" returned: 0 in 0.314s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:41 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 is being set with open permissions: ugo+rw Sep 19 00:04:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:41 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 Sep 19 00:04:41 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:41 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7" returned: 0 in 0.288s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:41 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.info Sep 19 00:04:41 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:41 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.info" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:41 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.info is being set with open permissions: ugo+rw Sep 19 00:04:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:42 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.info Sep 19 00:04:42 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:42 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.info" returned: 0 in 0.262s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.051s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8411b8fc-6840-4670-8f2d-3f2510850e81 tempest-ProjectMemberTests-883983225 None] Create snapshot completed successfully Sep 19 00:04:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-44651dab-4d25-455a-a25b-5192e3a158d7-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Lock "cinder-44651dab-4d25-455a-a25b-5192e3a158d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-4393a5bc-faf4-494c-96c9-b421ea344f5d" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-4393a5bc-faf4-494c-96c9-b421ea344f5d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-44651dab-4d25-455a-a25b-5192e3a158d7" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-44651dab-4d25-455a-a25b-5192e3a158d7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Deleting offline snapshot 44651dab-4d25-455a-a25b-5192e3a158d7 of volume 4393a5bc-faf4-494c-96c9-b421ea344f5d {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:04:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] snapshot_file for this snap is: volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:04:43 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[420362b5-374f-4419-83e7-7e9fb1c3656a]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:43 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 Sep 19 00:04:43 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:44 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7" returned: 0 in 0.391s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4393a5bc-faf4-494c-96c9-b421ea344f5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:04:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2097e0-9ede-4426-92c0-86a7432ea613]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:44 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d Sep 19 00:04:44 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:44 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d" returned: 0 in 0.389s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:44 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 Sep 19 00:04:44 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:44 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7" returned: 0 in 0.371s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:44 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7 Sep 19 00:04:44 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:45 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d.44651dab-4d25-455a-a25b-5192e3a158d7" returned: 0 in 0.260s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-44651dab-4d25-455a-a25b-5192e3a158d7" released by "_delete_snapshot" :: held 1.519s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-4393a5bc-faf4-494c-96c9-b421ea344f5d" released by "delete_snapshot" :: held 1.543s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Created reservations ['c2512937-d4f1-4063-a5d0-4f116ac25dc3', '83f9f8e3-7238-491a-a8fb-0016c76fc939', '8b050c35-7159-4224-a022-c7ca4ffccdfe', '6e19bdf5-48d6-410f-a395-affdd3769a4a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Delete snapshot completed successfully. Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c561e0a8-24d9-4146-9557-e73dde1dfdfc tempest-ProjectMemberTests-883983225 None] Lock "cinder-44651dab-4d25-455a-a25b-5192e3a158d7-delete_snapshot" released by "delete_snapshot" :: held 1.722s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Flow 'volume_create_manager' (3c7c68c9-7de5-4d7b-aaba-a94d7c5dbf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305105a4-1efd-4c42-bdd0-b294e2cc07d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305105a4-1efd-4c42-bdd0-b294e2cc07d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1286052347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8259569d-5fc4-421e-b3bf-27621e5b5974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55682c0d13d5452491d8bc327949d17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:45Z,use_quota=True,user_id='d5d2d3d24bba4a629b0e67ee1424b917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2607cf0-408d-44e3-9d3f-5347444fe7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2607cf0-408d-44e3-9d3f-5347444fe7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d476348-dd10-4635-bd9c-2fd53dc6b245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d476348-dd10-4635-bd9c-2fd53dc6b245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8259569d-5fc4-421e-b3bf-27621e5b5974', 'volume_name': 'volume-8259569d-5fc4-421e-b3bf-27621e5b5974', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb13323a-a9e1-4fed-8fe2-91f6ed387fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb13323a-a9e1-4fed-8fe2-91f6ed387fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ce08d7-9f12-489f-8896-e9839a400f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:45 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Volume 8259569d-5fc4-421e-b3bf-27621e5b5974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8259569d-5fc4-421e-b3bf-27621e5b5974', 'volume_size': 1} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1286052347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8259569d-5fc4-421e-b3bf-27621e5b5974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55682c0d13d5452491d8bc327949d17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:45Z,use_quota=True,user_id='d5d2d3d24bba4a629b0e67ee1424b917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Creating volume 8259569d-5fc4-421e-b3bf-27621e5b5974 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:45 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8259569d-5fc4-421e-b3bf-27621e5b5974 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:45 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8259569d-5fc4-421e-b3bf-27621e5b5974 1073741824 Sep 19 00:04:45 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-4393a5bc-faf4-494c-96c9-b421ea344f5d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Lock "cinder-4393a5bc-faf4-494c-96c9-b421ea344f5d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Acquiring lock "cinder-quobyte-4393a5bc-faf4-494c-96c9-b421ea344f5d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-4393a5bc-faf4-494c-96c9-b421ea344f5d" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cd3dad-c6de-4f76-8bfd-12af693ad5df]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:45 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d Sep 19 00:04:45 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:45 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8259569d-5fc4-421e-b3bf-27621e5b5974 1073741824" returned: 0 in 0.467s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8259569d-5fc4-421e-b3bf-27621e5b5974 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:46 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8259569d-5fc4-421e-b3bf-27621e5b5974 Sep 19 00:04:46 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:46 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d" returned: 0 in 0.373s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:46 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d Sep 19 00:04:46 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:46 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8259569d-5fc4-421e-b3bf-27621e5b5974" returned: 0 in 0.248s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ce08d7-9f12-489f-8896-e9839a400f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8259569d-5fc4-421e-b3bf-27621e5b5974', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8022f9-8504-4852-9f24-2d24e55ea108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:46 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Volume volume-8259569d-5fc4-421e-b3bf-27621e5b5974 (8259569d-5fc4-421e-b3bf-27621e5b5974): created successfully Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8022f9-8504-4852-9f24-2d24e55ea108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Flow 'volume_create_manager' (3c7c68c9-7de5-4d7b-aaba-a94d7c5dbf18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6c87947c-0c07-4e22-afdb-bdbcc11896f6 tempest-ProjectReaderTests-1753087720 None] Created volume successfully. Sep 19 00:04:46 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-4393a5bc-faf4-494c-96c9-b421ea344f5d" returned: 0 in 0.273s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Lock "cinder-quobyte-4393a5bc-faf4-494c-96c9-b421ea344f5d" released by "delete_volume" :: held 0.720s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Created reservations ['258b7fbd-4d04-49bc-ad6e-324b34267042', 'eac9bf1d-416a-4af2-8515-1d045903240f', '2b84c2ea-525f-4cba-a683-0a022ed37764', '7aa47ae9-4d06-4009-b922-17da12ffc3a9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:46 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:46 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Acquiring lock "cinder-8259569d-5fc4-421e-b3bf-27621e5b5974-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Lock "cinder-8259569d-5fc4-421e-b3bf-27621e5b5974-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Acquiring lock "cinder-quobyte-8259569d-5fc4-421e-b3bf-27621e5b5974" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Lock "cinder-quobyte-8259569d-5fc4-421e-b3bf-27621e5b5974" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[453fa73b-098f-4919-a953-3ccb492cb35a]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8259569d-5fc4-421e-b3bf-27621e5b5974 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:46 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8259569d-5fc4-421e-b3bf-27621e5b5974 Sep 19 00:04:46 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:46 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.277s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Deleted volume successfully. Sep 19 00:04:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3aa71dde-63db-4196-bc4f-78d3839bd273 tempest-ProjectMemberTests-883983225 None] Lock "cinder-4393a5bc-faf4-494c-96c9-b421ea344f5d-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:47 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8259569d-5fc4-421e-b3bf-27621e5b5974" returned: 0 in 0.386s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8259569d-5fc4-421e-b3bf-27621e5b5974 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:47 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8259569d-5fc4-421e-b3bf-27621e5b5974 Sep 19 00:04:47 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:47 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-8259569d-5fc4-421e-b3bf-27621e5b5974" returned: 0 in 0.270s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Lock "cinder-quobyte-8259569d-5fc4-421e-b3bf-27621e5b5974" released by "delete_volume" :: held 0.699s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Created reservations ['2259a3d8-3998-407a-8c23-aaae5cd03e3a', '05196846-1ef1-43dc-8310-f6d43c8842d2', '32e7d2da-0f68-4b4d-a87e-44d734b36be2', '4d10bb69-d1c1-499e-ba9c-b0a767286d2e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:47 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:47 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:47 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Deleted volume successfully. Sep 19 00:04:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30590b7a-2e2e-40c2-b71e-4d5eb8841864 tempest-ProjectReaderTests-1753087720 None] Lock "cinder-8259569d-5fc4-421e-b3bf-27621e5b5974-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Flow 'volume_create_manager' (d0afb035-cee3-40b3-970c-b35504023378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84559e4c-9529-418f-b31e-54e0f8482886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84559e4c-9529-418f-b31e-54e0f8482886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1237028310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3302de-64c8-45c0-9018-db48d04c2f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55682c0d13d5452491d8bc327949d17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:48Z,use_quota=True,user_id='d5d2d3d24bba4a629b0e67ee1424b917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a01ea8-9bf5-476b-8d93-dcb50ee2a2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a01ea8-9bf5-476b-8d93-dcb50ee2a2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08298fe-0f93-433a-99ad-4874c825eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08298fe-0f93-433a-99ad-4874c825eb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3302de-64c8-45c0-9018-db48d04c2f98', 'volume_name': 'volume-cf3302de-64c8-45c0-9018-db48d04c2f98', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db35ef2-aa8b-4f66-829e-6aa9398cc89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db35ef2-aa8b-4f66-829e-6aa9398cc89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd3f876-087d-41db-8559-9856dbec7982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:48 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Volume cf3302de-64c8-45c0-9018-db48d04c2f98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3302de-64c8-45c0-9018-db48d04c2f98', 'volume_size': 1} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1237028310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3302de-64c8-45c0-9018-db48d04c2f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55682c0d13d5452491d8bc327949d17b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:04:48Z,use_quota=True,user_id='d5d2d3d24bba4a629b0e67ee1424b917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Creating volume cf3302de-64c8-45c0-9018-db48d04c2f98 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:04:48 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf3302de-64c8-45c0-9018-db48d04c2f98 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:48 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf3302de-64c8-45c0-9018-db48d04c2f98 1073741824 Sep 19 00:04:48 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:48 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf3302de-64c8-45c0-9018-db48d04c2f98 1073741824" returned: 0 in 0.470s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf3302de-64c8-45c0-9018-db48d04c2f98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:48 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf3302de-64c8-45c0-9018-db48d04c2f98 Sep 19 00:04:48 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:49 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf3302de-64c8-45c0-9018-db48d04c2f98" returned: 0 in 0.249s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:04:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd3f876-087d-41db-8559-9856dbec7982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3302de-64c8-45c0-9018-db48d04c2f98', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f6dc71-7eec-4045-91d7-9b33daf4f775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:04:49 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Volume volume-cf3302de-64c8-45c0-9018-db48d04c2f98 (cf3302de-64c8-45c0-9018-db48d04c2f98): created successfully Sep 19 00:04:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f6dc71-7eec-4045-91d7-9b33daf4f775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:04:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Flow 'volume_create_manager' (d0afb035-cee3-40b3-970c-b35504023378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:04:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-63e78e74-0ea7-4d8f-95d6-6b4b2a98fa4c tempest-ProjectReaderTests-1753087720 None] Created volume successfully. Sep 19 00:04:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Acquiring lock "cinder-cf3302de-64c8-45c0-9018-db48d04c2f98-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Lock "cinder-cf3302de-64c8-45c0-9018-db48d04c2f98-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Acquiring lock "cinder-quobyte-cf3302de-64c8-45c0-9018-db48d04c2f98" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:04:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Lock "cinder-quobyte-cf3302de-64c8-45c0-9018-db48d04c2f98" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:04:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8365a70a-dc21-44c4-a1b8-5563345103be]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:04:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf3302de-64c8-45c0-9018-db48d04c2f98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:50 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf3302de-64c8-45c0-9018-db48d04c2f98 Sep 19 00:04:50 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:50 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf3302de-64c8-45c0-9018-db48d04c2f98" returned: 0 in 0.393s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf3302de-64c8-45c0-9018-db48d04c2f98 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:50 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf3302de-64c8-45c0-9018-db48d04c2f98 Sep 19 00:04:50 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:51 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-cf3302de-64c8-45c0-9018-db48d04c2f98" returned: 0 in 0.255s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Lock "cinder-quobyte-cf3302de-64c8-45c0-9018-db48d04c2f98" released by "delete_volume" :: held 0.698s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:04:51 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Created reservations ['cda8723f-2a87-4cd9-9958-1066866b7526', '0e15547e-4b55-4f7b-9fad-1b0987e5dbf2', 'a0c76ba8-35a9-4b09-9bc2-eb4d5785e1d2', '49b983fd-8ea3-44d9-85a8-0aeef17eaea7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:04:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:04:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:04:51 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:04:51 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:04:51 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 19 00:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.257s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:04:51 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:04:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Deleted volume successfully. Sep 19 00:04:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b5cadf8c-bf57-47e0-83fc-0615541c640f tempest-ProjectReaderTests-1753087720 None] Lock "cinder-cf3302de-64c8-45c0-9018-db48d04c2f98-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:05:01 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:DELETE=30,cinder:SELECT=230,cinder:INSERT=77,cinder:UPDATE=319 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 19 00:05:01 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=311,cinder:DELETE=24,cinder:SELECT=221,cinder:INSERT=85 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Flow 'volume_create_manager' (e8cfaf54-b317-4ff6-98ef-f5f379e19af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249fefc2-e480-49f2-9db5-a8274675278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249fefc2-e480-49f2-9db5-a8274675278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1622150529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7786ec8-65ba-4c4d-b2cc-dea18dda00be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b682f62f4048088112a424e2b973dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:05:12Z,use_quota=True,user_id='20cce893cd1d42b0a197fdd109b984e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbdb7cc0-10eb-4f9d-9075-6ed82dcf2fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbdb7cc0-10eb-4f9d-9075-6ed82dcf2fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29707f0-3e5b-49d3-9dde-3045780706e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29707f0-3e5b-49d3-9dde-3045780706e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7786ec8-65ba-4c4d-b2cc-dea18dda00be', 'volume_name': 'volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b478fd36-1a6a-4d3f-884c-e3e635e8aef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b478fd36-1a6a-4d3f-884c-e3e635e8aef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df128f47-47a9-4caf-b8cd-86ced448b0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:05:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Volume b7786ec8-65ba-4c4d-b2cc-dea18dda00be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be', 'volume_size': 1} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1622150529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7786ec8-65ba-4c4d-b2cc-dea18dda00be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b682f62f4048088112a424e2b973dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:05:12Z,use_quota=True,user_id='20cce893cd1d42b0a197fdd109b984e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Creating volume b7786ec8-65ba-4c4d-b2cc-dea18dda00be {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:05:12 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] casted to osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:12 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be 1073741824 Sep 19 00:05:12 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:12 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be 1073741824" returned: 0 in 0.402s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:12 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be Sep 19 00:05:12 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:13 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be" returned: 0 in 0.234s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 19 00:05:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:05:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df128f47-47a9-4caf-b8cd-86ced448b0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:05:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3972a0c7-222c-4b9b-b452-07ae5d598ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:05:13 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Volume volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be (b7786ec8-65ba-4c4d-b2cc-dea18dda00be): created successfully Sep 19 00:05:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3972a0c7-222c-4b9b-b452-07ae5d598ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:05:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Flow 'volume_create_manager' (e8cfaf54-b317-4ff6-98ef-f5f379e19af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:05:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1d870d24-4705-4daa-b0ec-c2b8f6bb7e67 tempest-SnapshotDependencyTests-561490691 None] Created volume successfully. Sep 19 00:05:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:05:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:05:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] Creating offline snapshot 0cbaa50e-8db9-4da8-87b8-4df8eb629441 of volume b7786ec8-65ba-4c4d-b2cc-dea18dda00be {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 19 00:05:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[59daa1d5-03f3-4f3e-ae9c-134c36c9cde8]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:05:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:13 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be Sep 19 00:05:13 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:13 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:14 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 1G Sep 19 00:05:14 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:14 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 1G" returned: 0 in 0.395s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:14 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 Sep 19 00:05:14 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:14 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be -F qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441" returned: 0 in 0.300s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:14 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 is being set with open permissions: ugo+rw Sep 19 00:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:14 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 Sep 19 00:05:14 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:14 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441" returned: 0 in 0.239s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:14 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.info Sep 19 00:05:15 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:15 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.info" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:15 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.info is being set with open permissions: ugo+rw Sep 19 00:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:15 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.info Sep 19 00:05:15 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:15 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.info" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:05:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-525d7005-b761-4bb4-b844-285929c5283e tempest-SnapshotDependencyTests-561490691 None] Create snapshot completed successfully Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Flow 'volume_create_manager' (6662355a-60ba-4631-9b93-44955021a718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694947c1-ae59-41b9-906f-f8091bc1c956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694947c1-ae59-41b9-906f-f8091bc1c956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-18T22:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08178b6-fc38-478b-ad39-37a834e811ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b682f62f4048088112a424e2b973dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-18T22:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0cbaa50e-8db9-4da8-87b8-4df8eb629441,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-18T22:05:16Z,use_quota=True,user_id='20cce893cd1d42b0a197fdd109b984e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cca2daf-c6e6-4460-aba7-60957ea9fc60),volume_type_id=4cca2daf-c6e6-4460-aba7-60957ea9fc60)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcabed6-85a0-4571-9fd4-145f5e8ff6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcabed6-85a0-4571-9fd4-145f5e8ff6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04834df8-e042-4012-82d3-7646c3734b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04834df8-e042-4012-82d3-7646c3734b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a08178b6-fc38-478b-ad39-37a834e811ed', 'volume_name': 'volume-a08178b6-fc38-478b-ad39-37a834e811ed', 'volume_size': 1, 'snapshot_id': '0cbaa50e-8db9-4da8-87b8-4df8eb629441'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d6235f-cafd-4015-9481-bb3ab3125d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d6235f-cafd-4015-9481-bb3ab3125d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ef4c6f-3038-4f74-b6bf-ad2b00834b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:05:16 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Volume a08178b6-fc38-478b-ad39-37a834e811ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a08178b6-fc38-478b-ad39-37a834e811ed', 'volume_size': 1, 'snapshot_id': '0cbaa50e-8db9-4da8-87b8-4df8eb629441'} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "cinder-quobyte-0cbaa50e-8db9-4da8-87b8-4df8eb629441-a08178b6-fc38-478b-ad39-37a834e811ed" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-quobyte-0cbaa50e-8db9-4da8-87b8-4df8eb629441-a08178b6-fc38-478b-ad39-37a834e811ed" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Creating volume a08178b6-fc38-478b-ad39-37a834e811ed from snapshot 0cbaa50e-8db9-4da8-87b8-4df8eb629441 {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Selected osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "cinder-quobyte-a08178b6-fc38-478b-ad39-37a834e811ed" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-quobyte-a08178b6-fc38-478b-ad39-37a834e811ed" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] snapshot: 0cbaa50e-8db9-4da8-87b8-4df8eb629441, volume: a08178b6-fc38-478b-ad39-37a834e811ed, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c54561a-5020-4dd4-adba-5017617c8adf]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:16 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 Sep 19 00:05:16 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:16 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441" returned: 0 in 0.351s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3bb835-7097-4b0f-b689-64af1f7fc21d]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:16 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be Sep 19 00:05:16 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:17 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be" returned: 0 in 0.357s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 19 00:05:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 19 00:05:17 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Path /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 19 00:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:17 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed Sep 19 00:05:17 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 19 00:05:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:05:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:05:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:05:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:05:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:05:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:21 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:05:21 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:21 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.505s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:05:21 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 19 00:05:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread count: 29 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 19 00:05:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-02199a14-408b-4646-8e41-0cbebb1271aa None None] thread info: [<_MainThread(MainThread, started 137041671749760)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 19 00:05:22 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed" returned: 0 in 5.814s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:22 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Image conversion details: src /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 19 00:05:22 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Converted 1024.00 MB image at 176.11 MB/s Sep 19 00:05:22 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed is being set with open permissions: ugo+rw Sep 19 00:05:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:22 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed Sep 19 00:05:22 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:23 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed" returned: 0 in 0.245s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-quobyte-a08178b6-fc38-478b-ad39-37a834e811ed" released by "_copy_volume_from_snapshot" :: held 6.845s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-quobyte-0cbaa50e-8db9-4da8-87b8-4df8eb629441-a08178b6-fc38-478b-ad39-37a834e811ed" released by "_create_volume_from_snapshot" :: held 6.907s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.921s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ef4c6f-3038-4f74-b6bf-ad2b00834b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08178b6-fc38-478b-ad39-37a834e811ed', 'volume_size': 1, 'snapshot_id': '0cbaa50e-8db9-4da8-87b8-4df8eb629441'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc23efff-76a7-4fcc-823e-dea541f30e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 19 00:05:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Volume volume-a08178b6-fc38-478b-ad39-37a834e811ed (a08178b6-fc38-478b-ad39-37a834e811ed): created successfully Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc23efff-76a7-4fcc-823e-dea541f30e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Flow 'volume_create_manager' (6662355a-60ba-4631-9b93-44955021a718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 19 00:05:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b42be84a-92fc-4b4e-a588-9eff16307767 tempest-SnapshotDependencyTests-561490691 None] Created volume successfully. Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "cinder-0cbaa50e-8db9-4da8-87b8-4df8eb629441-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-0cbaa50e-8db9-4da8-87b8-4df8eb629441-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "cinder-quobyte-b7786ec8-65ba-4c4d-b2cc-dea18dda00be" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-quobyte-b7786ec8-65ba-4c4d-b2cc-dea18dda00be" acquired by "delete_snapshot" :: waited 0.013s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "cinder-quobyte-0cbaa50e-8db9-4da8-87b8-4df8eb629441" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-quobyte-0cbaa50e-8db9-4da8-87b8-4df8eb629441" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Deleting offline snapshot 0cbaa50e-8db9-4da8-87b8-4df8eb629441 of volume b7786ec8-65ba-4c4d-b2cc-dea18dda00be {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] snapshot_file for this snap is: volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 19 00:05:23 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f369e15-798a-44c6-841a-3c5414488e16]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:05:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:24 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 Sep 19 00:05:24 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:24 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 19 00:05:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[de80f0a2-39ea-4206-8499-16591728f6a1]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:05:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:24 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be Sep 19 00:05:24 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:24 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be" returned: 0 in 0.526s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:24 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 Sep 19 00:05:24 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:25 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441" returned: 0 in 0.319s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:25 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441 Sep 19 00:05:25 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:25 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be.0cbaa50e-8db9-4da8-87b8-4df8eb629441" returned: 0 in 0.245s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-quobyte-0cbaa50e-8db9-4da8-87b8-4df8eb629441" released by "_delete_snapshot" :: held 1.550s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:05:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-quobyte-b7786ec8-65ba-4c4d-b2cc-dea18dda00be" released by "delete_snapshot" :: held 1.574s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:05:25 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Created reservations ['7b785d81-f41c-4a80-9733-c72015ed7470', '7e604dad-0c3c-4870-b214-5b626d9989a1', '5a9e1edc-52fb-4297-9cdb-543c4f6e1461', 'e9816035-3355-4201-9d69-f6cbc262de04'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:05:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Delete snapshot completed successfully. Sep 19 00:05:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a48c6531-1d11-401a-a071-6f9adbfe7188 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-0cbaa50e-8db9-4da8-87b8-4df8eb629441-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "cinder-b7786ec8-65ba-4c4d-b2cc-dea18dda00be-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-b7786ec8-65ba-4c4d-b2cc-dea18dda00be-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "cinder-quobyte-b7786ec8-65ba-4c4d-b2cc-dea18dda00be" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-quobyte-b7786ec8-65ba-4c4d-b2cc-dea18dda00be" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce391fd8-48c2-431f-8a07-911b5a7a6044]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:26 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be Sep 19 00:05:26 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:26 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be" returned: 0 in 0.361s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:26 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be Sep 19 00:05:26 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:26 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-b7786ec8-65ba-4c4d-b2cc-dea18dda00be" returned: 0 in 0.246s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-quobyte-b7786ec8-65ba-4c4d-b2cc-dea18dda00be" released by "delete_volume" :: held 0.667s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Created reservations ['8e3e81bf-58cd-45af-b0fb-8fcf662223aa', 'dfee55bc-dfdf-4486-8596-9a0d215c4ec2', '738c0da3-4ce1-403b-86b9-de207acb1f0c', '2cb4fd96-0e53-4cfc-9068-a4589787fe81'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:26 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:05:26 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:27 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:05:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Deleted volume successfully. Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9ba90765-cc39-4653-92b1-aa8b1d7c1279 tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-b7786ec8-65ba-4c4d-b2cc-dea18dda00be-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "cinder-a08178b6-fc38-478b-ad39-37a834e811ed-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-a08178b6-fc38-478b-ad39-37a834e811ed-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "cinder-quobyte-a08178b6-fc38-478b-ad39-37a834e811ed" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-quobyte-a08178b6-fc38-478b-ad39-37a834e811ed" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c99737-8357-43f2-8773-30726d519327]: (4, 'qcow2') {{(pid=87758) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:27 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed Sep 19 00:05:27 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:27 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:27 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed Sep 19 00:05:27 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:27 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413/volume-a08178b6-fc38-478b-ad39-37a834e811ed" returned: 0 in 0.240s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-quobyte-a08178b6-fc38-478b-ad39-37a834e811ed" released by "delete_volume" :: held 0.633s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:05:27 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Created reservations ['e3939e55-a475-482b-8b92-2aacdb0831a4', '3c78a5e8-1562-4286-a5d8-dd9cd559b92b', '001d4677-f5d1-4d7a-91b7-9ed89c0809ff', '2e943642-9962-46fd-a29e-ac07a8a34ae5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 19 00:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 19 00:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 19 00:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 19 00:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3cf48ebe-7799-4945-8a38-3ab3f15eeb5b'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 19 00:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 19 00:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 19 00:05:28 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413 Sep 19 00:05:28 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 19 00:05:28 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 19 00:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e2c523e545d1dad59e32c51af9da6413" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 19 00:05:28 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 19 00:05:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Deleted volume successfully. Sep 19 00:05:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6f41287-88de-4224-9d84-4702fbeaff7c tempest-SnapshotDependencyTests-561490691 None] Lock "cinder-a08178b6-fc38-478b-ad39-37a834e811ed-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 19 00:05:38 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=27,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 19 00:05:38 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=22,cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=4 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 19 00:05:54 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}